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TACCDAS  TESTBED  HUMAN  FACTORS  EVALUATION 
METHODOLOGY 


INTRODUCTION 


This  report  considers  the  human  factors  procedures  for  the 
evaluation  of  the  design,  functional  performance  and  envi¬ 
ronmental  considerations  for  the  major  test  functions  (op¬ 
erability,  maintainability,  portability/usability,  and  ha¬ 
bitability)  related  to  the  TACCDAS  testbed  evaluation.  In 
the  development  of  the  procedures  and  criteria  that  can  be 
applied  in  the  testbed  evaluation,  the  recommendations 
contained  in  the  reports  by  Perkins  et  al  (1977)  and  by 
Malone  (1978)  on  human  factors  test  and  evaluation  of  mil¬ 
itary  systems  have  been  used  as  a  basis  and  made  relevant 
to  an  information  system  evaluation. 

The  primary  aim  in  such  testing  is  the  assessment  of 
the  effectiveness  and  degree  of  safety  with  which  test 
items  can  be  operated,  maintained,  occupied,  transported 
or  otherwise  used  by  qualified  personnel  in  the  designated 
env i ronment . 

Military  testing  of  new  systems  must  include  an  as¬ 
sessment  of  performance  of  personnel  using  the  system.  it 
is  often  assumed  that  personnel  performance  testing  is  not 
necessary,  since  the  user  can  adapt  to  the  demands  of  his 
equipment,  and  so  overcome  the  features  that  cause  diffi¬ 
culty.  His  ability  to  be  flexible  and  adaptive  in  combat 
is  reduced,  however,  by  the  presence  of  stresses,  and  the 
areas  of  potential  performance  unreliability  should  be 
identified  by  performance  testing  while  applying  those 
stresses. 

A  human  factors  evaluation  of  a  system  includes  the 
complex  of  elements  that  affect  personnel  performance, 

1.  the  physical  design  characteristics  of  the  equip¬ 
ment 

2.  procedures  for  operating  and  maintaining  the 
equipment 

3.  training  for  effective  operation  and  maintenance 
of  the  equipment 

4.  the  design  and  the  utility  of  manuals  and  docu¬ 
mentation 

5.  the  environment  in  which  the  system  is  operated 
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There  are  three  major  sources  of  information  for  the  eva¬ 
luation: 

1.  the  system  documentation 

2.  observation  of  the  system 

3.  the  users  of  the  system,  in  this  case,  the  test 
participants  who  are  the  users  of  the  command  and 
control  information  sub-system  (the  testbed)  and 
who  are  the  users  of  sub-systems  commanded  and 
controlled  by  it. 

The  system  description  documentation  is  available,  so  the 
formal  and  intended  structure  and  functioning  of  the 
testbed  is  known.  Observation  f  the  system  in  use  pro¬ 
vides  data  on  the  system  as  it  really  is,  which  inevitably 
will  be  different  in  several  ways  from  the  intended  system 
as  foreseen  by  the  system  designers.  The  system  users 
provide  insights  into  these  differences,  why  they  exist, 
and  the  most  profitable  approaches  to  improving  the  system 
functioning  and  acceptabil ity. 


T ACC DAS  TESTBED  EVALUATION 
SCHEDULE 

This  schedule  for  the  sequence  of  events  for  evalua¬ 
tion  through  the  development  of  the  minitestbed  and  the 
testbed  is  based  on  the  decisions  made  by  the  TACCDAS  pro¬ 
ject  team  up  to  the  time  of  publication  of  this  report. 


1.  MEASURES  DEFINITION  AND  CONSTRUCTION 

The  evaluation  team  will  identify,  define  and  construct 
the  tools  required  to  obtain  the  necessary  measures  of  ef¬ 
fectiveness  during  field  operations.  These  may  include 
questionnaires,  interview  proformas  and  methods  for  direct 
observation.  The  behaviours  that  are  to  be  measured  or 
assessed  will  be  defined  at  a  preliminary  level,  to  be 
validated  in  the  assessment  of  the  manual  execise. 

Reference  will  be  made  to 

1.  the  findings  of  and  techniques  employed  by  the 
'Study  of  the  combat  data  handling  procedures 
within  the  Canadian  Land  Forces  in  the  field', 
P.  S.  Ross  and  Partners,  1959-70,  as  contracted 
to  DND  under  contract  GR  733005,  26  March  1963. 

the  experience  and  findings  of  the  Exercise  Tal- 
fos  series,  especially  as  summarized  in  'User 
concept  evaluation  trials  of  the  DREV  Phase  I 
TADPS  facility.  Exercise  Tal fos  summary  report. 


2. 
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D.  Heckman  et  al,  DREV  Report  412r>/79.  May  1979. 


2.  MANUAL  EXERCISE  EVALUATION 

The  techniques  to  be  used  for  evaluation  of  the  worksta¬ 
tion  and  testbed  will  be  tested  during  a  manual  command 
post  exercise.  This  will  provided  an  opportunity  for  col¬ 
lection  of  baseline  data  for  comparative  purposes  and  for 
the  definition  of  field  concept  evaluation  measures. 

Test  participants  will  be  identified  and  classified 
according  to  the  factors  outlined  in  the  Test  Method  sec¬ 
tion  of  this  paper.  Operator  tasks  will  be  assessed  dur¬ 
ing  a  walk-through  of  the  user  task  procedures.  This  can 
form  a  basis  for  determining  relative  task  criticality, 
from  which  the  tests  that  are  to  included  for  evaluation 
are  selected.  Refinement  of  the  classification  of  task 
criticality  can  be  made  after  the  manual  exercise  data  has 
been  reviewed. 

The  questions  relating  to  performance  requirements 
will  be  answered  for  all  the  relevant  tasks  during  the 
manual  exercise,  to  be  used  as  a  guide  for  data  capture 
and  observer  tasks  during  the  subsequent  evaluations. 

Performance  measures  used  in  the  manual  exercise  can 
only  be  based  on  observation  ,  interview  and  questionnaire 
techniques,  since  no  data  logging  of  operator  behaviour  at 
the  workstation  will  be  possible.  Most  of  the  information 
processed  in  the  command  post  is  transient,  insofar  as  it 
is  recorded  temporarily  on  some  medium  until  it  is  erased 
when  superceded  by  new  information.  A  review  of  these  re¬ 
cords  after  the  exercise  would  provide  only  end  solutions 
and  status  conditions,  therefore.  Data  on  operator  ac¬ 
tions  must  be  obtained  by  observation.  These  observation 
records  will  provide  a  basis  for  further  definition  of  the 
tasks  elements  that  are  most  suitable  for  data  logging  in 
the  minitestbed  evaluations,  however. 

In  conducting  observation  procedures,  the  information 
in  the  Performance  Tests  section  of  this  paper  should  be 
applied.  Observers  should  use  a  reporting  form  on  which 
to  record  the  events  that  are  observed.  it  should  be 
based  on  an  operating  procedure  as  a  guide  to  task  perfor¬ 
mance  so  that  steps  can  be  checked  off  or  annotated  as  the 
task  is  performed,  for  those  parts  of  the  task  that  are 
proceduralized.  For  more  continuous  and  variable  aspects 
of  the  tasks,  a  checklist  of  significant  elements  of  the 
task  should  be  prepared  as  a  guide  as  to  what  should  be 
observed.  A  sample  of  the  format  for  the  reporting  form 
is  attached  as  Annex  F. 


For  the  conduct  of  interviews  the  information  in  the 


Performance  Tests  section  of  this  paper  should  be  applied. 
The  sample  list  of  items  provided  in  that  section  can  be 
used  as  a  basis  for  constructing  a  structured  interview 
format.  This  can  be  refined  after  the  experience  of  the 
manual  exercise  to  form  an  interview  format  most  suitable 
for  the  minitestbed  evaluation. 

For  preparing  and'  administering  questionnaires  the 
information  provided  in  the  Performance  Tests  section  of 
this  paper  should  be  applied. 


3.  CRITICAL  DESIGN  REVIEW  -  TECHNICAL 

This  stage  involves  initial  engineering  trials  of  the 
workstation  to  ensure  proper  interaction  between  the  dis¬ 
play  and  data  manipulation  devices  and  the  software  pro¬ 
grams. 

These  trials  will  involve  the  technical  design  staff  only 
with  no  military  subjects.  No  scenario  or  gaming  will  be 
attempted,  since  the  aim  will  be  to  establish  the  func¬ 
tional  integrity  of  the  hardware  and  software  modules  of 
the  workstation  as  designed  and  built,  and  their  efficient 
i nteraction . 


4.  CRITICAL  DESIGN  REVIEW  -  OPERATIONAL 

The  aim  of  this  evaluation  will  be  the  assessment  of  the 
individual  workstation  in  terms  of  physical  design  charac¬ 
teristics  and  the  facilities  provided  for  the  carrying  out 
of  procedures  typically  employed  at  brigade  or  at  unit 
level.  This  review  will  constitute  acceptance  of  the  phy¬ 
sical  design  and  the  functioning  of  the  workstation  for 
use  in  the  subsequent  evaluation  trials.  No  military  sub¬ 
jects  will  be  used  in  this  design  review.  No  scenarios 
will  be  employed  in  the  sense  of  a  predetermined  game  with 
continuity  and  integrated  meaning  extending  over  an  ex¬ 
tended  period. 

For  the  conduct  of  the  critical  design  review,  the 
factors  outlined  in  the  applicable  part  of  the  Test  proce¬ 
dures  section  of  this  paper  should  be  applied.  A  check¬ 
list  approach  should  be  used  to  ensure  that  all  relevant 
issues  are  considered,  and  this  should  be  applied  by  sev¬ 
eral  project  and  scientific  evaluators  independently.  The 
checklists  should  then  be  combined  to  obtain  concensus 
opinion  on  the  factors  assessed. 


5.  MINITEST8ED  ENGINEERING  EVALUATION 

Engineering  trials  will  be  conducted  on  two  or  more  works¬ 
tations  working  together,  communicating  information  and 


interacting  simultaneously  with  the  software  system. 

These  trials  would  be  conducted  by  the  technical  design 
staff  with  no  military  subjects  required.  The  aim  would 
be  the  proving  of  the  communication  links  between  the  var¬ 
ious  workstations  (already  proven  individually)  and  the 
computer  software  system,  and  the  proving  of  the  software 
system  working  with  more  than  one  user  terminal.  The  ap¬ 
plication  of  predetermined  sequences  to  exercise  the  sys¬ 
tem  will  ensure  completeness  in  this  phase  of  the  testing 
of  the  system,  but  advantage  can  be  gained  by  also  permit¬ 
ting  the  use  of  non-standard  sequences  that  have  not  been 
anticipated  by  the  system  designers.  This  can  identify 
previously  undetected  interactions  within  the  software  or 
hardware  system  and  so  avoid  their  appearing  for  the  first 
time  when  used  by  the  test  subjects. 


6.  MINITEST3ED  CONCEPT  EVALUATION 

A  user  evaluation  will  be  conducted  on  the  use  of  the  fa¬ 
cilities,  work  procedures  and  the  software  response  for 
two  or  more  workstations  working  together  simultaneously. 
Communication  between  the  staff  cells  would  be  assessed, 
and  the  ability  to  monitor  changes  to  data  elements  ef¬ 
fected  by  another  station  would  be  noted.  System  response 
to  the  demands  made  by  the  players  would  be  measured. 
Subjective  measures  would  be  made  of  the  players'  res¬ 
ponses  and  attitudes  to  the  testbed  system. 

The  evaluation  would  concentrate  on  one  area  at  any  one 
time,  due  to  the  facilities  provided  in  the  m i n i- testbed . 
With  other  portions  of  the  operation  simulated,  the  evalu¬ 
ation  will  be  of 

1.  the  Operations  cell  manned  by  2  duty  officers 

2.  the  Intelligence  cell,  manned  by  one  or  two  as 
appropriate 

3.  the  Operations  and  Intelligence  cells  working  to¬ 
gether 

4.  a  unit  CP,  with  either  one  or  two  duty  officers, 
and  operating  both  in  the  manual  and  the  TACCDAS 
mode . 


Military  subjects  would  be  used  under  a  limited  scenario 
designed  to  cover  a  broad  range  of  workstation  activities 
rather  than  to  present  the  users  with  a  realistic  sequence 
of  military  events.  A  training  period  would  be  required 
to  familiarize  users  with  the  workstation  and  the  proce¬ 
dures  for  communicating  with  the  computer  system.  This 
would  be  a  ' laboratory'  style  of  test  insofar  as  there 
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would  be  minimal  attempt  made  to  achieve  military  exercise 
cond i t ions . 

The  measures  used  will  be  both  objective  data  logging 
of  test  participant  performance,  and  subjective  data  col¬ 
lection  by  observation,  interview  and  questionnaire.  The 
information  provided  in  the  Performance  Tests  section  of 
this  paper  should  be  applied,  as  developed  and  refined  by 
the  experience  of  the  manual  exercise  evaluation. 


7.  COMMAND  POST  TECHNICAL  EVALUATION 

This  stage  comprises  a  technical  evaluation  of  the 
hardware  and  software  system  for  a  Brigade  command  post  as 
to  be  fielded  for  the  field  concept  evaluation. 

Military  subjects  will  be  used  to  provide  the  manpower  to 
operate  the  system  for  the  technical  design  staff,  in 
order  to  provide  the  data  on  system  operation  necessary 
for  assessing  its  functional  status.  These  should  not  be 
the  subjects  to  be  used  in  the  field  concept  evaluation, 
to  avoid  influencing  attitudes  of  trial  subjects  by  expo¬ 
sure  to  a  system  in  the  proving  stage.  It  would  be  unne¬ 
cessary  to  attempt  realism  in  this  trial  for  the  reasons 
outlined  in  para  6  above.  A  predetermined  set  of  proce¬ 
dure  modules  would  provide  more  technical  information 
while  avoiding  the  complication  of  maintaining  a  scenario 
continuity. 


8.  COMMAND  POST  CONCEPT  EVALUATION 

CPX-style  evaluation  of  testbed  use  with  the  full  command 
post  operating  with  a  prescribed  scenario  and  as  much  re¬ 
alism  as  can  can  be  generated  with  no  troops  on  the 
ground.  , 

Military  subjects  would  be  trained  in  testbed  use,  in 
terms  of  procedures  for  use  of  the  testbed  systems,  and 
would  be  briefed  on  the  aims  and  limitations  of  the  test. 

The  performance  measures  applied  will  be  as  used  in 
the  minitestbed  evaluation,  refined  on  the  basis  of  that 
experience,  and  developed  as  required  to  satisfy  the  re¬ 
quirements  of  the  larger  exercise. 


9.  FIELD  CONCEPT  EVALUATION 

The  evaluation  of  the  field  concept  evaluation  will  be 
based  on  the  experience  of  the  previous  evaluations,  in 
terms  of  both  use  of  measures  and  the  tasks  and  behaviours 
that  are  measured.  These  will  be  refined  and  developed  as 
required  to  cater  to  the  increased  size  of  the  exercise. 


TEST  METHOD 


DEVELOPMENT  OF  PERFORMANCE  CRITERIA 

Evaluation  has  been  defined  as  the  means  by  which  the 
performance  of  hardware,  procedures  and  personnel  are  ob¬ 
served  as  a  system,  to  verify  that  the  system  and  its  com¬ 
ponents  will  do  what  they  are  supposed  to  do  (Meister  and 
Rabideau,  1965).  This  implies  a  comparison  of  the  perfor¬ 
mance  that  is  observed  with  the  standards  that  define  what 
is  expected. 

For  the  testbed  evaluation,  that  standard  dictates 
the  approach  to  the  conduct  of  the  evaluation.  There  are 
no  objective  personnel  performance  criteria  inherent  in 
the  subject  matter,  however,  (e.  g.  the  ability  to  cor¬ 
rectly  handle  15  messages  per  hour),  and  performance  stan¬ 
dards  are  not  objective  and  specifiable.  Arbitrary  cri¬ 
teria  must  be  established,  therefore.  Instead  of  testing 
being  relative  to  a  criterion,  it  must  be  relative  to  a 
norm,  or  accepted  level  of  performance  against  which  ob¬ 
served  performance  will  be  compared. 

The  norm  against  which  the  testbed  performance  will 
be  compared  will  be  a  set  of  performance  standards  based 
on  measures  taken  in  a  manual  exercise  using  similar  test 
participants.  Particularly,  the  scenario,  scope,  size, 
phase  of  war  and  the  concept  of  operations  of  the  exer¬ 
cises  should  be  the  same.  The  questions  asked  will  thus 
be  in  terms  of  whether  the  tasks  were  performed  more  ef¬ 
fectively  with  automated  aiding  than  in  the  manual  system, 
rather  than  in  terms  of  were  they  performed  to  an  absolute 
standard  of  acceptance  with  automated  aiding. 

The  measures  that  are  developed  for  the  testbed  eva¬ 
luation  must  be  used  first  for  an  evaluation  of  a  manual 
exercise  of  a  similar  complexity  t*  the  one  to  be  used  in 
the  testbed  evaluation.  The  results  of  that  manual  evalu¬ 
ation  will  form  the  baseline  data  for  testbed  performance 
evaluation. 


TEST  PARTICIPANT  IDENTIFICATION 

Test  participants  must  be  identified  by  appropriate 
characteristics,  such  as  Mt)C,  skill  level,  and  training, 
to  ensure  that  they  are  representative  of  the  eventual 
user  population.  Distribution  of  the  following  qualities 
in  the  test  sample  shall  be  similar  to  the  population  dis¬ 
tribution,  within  selection  constraints.  That  is,  the 
brigade  that  has  been  identified  for  providing  test  sub¬ 
jects  may  have  personnel  that  are  representative  of  the 
personnel  in  the  other  brigades  in  terms  of  these  criter¬ 
ia.  By  chance,  they  may  provide  a  selected  sample  that 
are  not  representative  in  some  import  ant  aspect.  given 
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the  limitations  imposed  on  the  availability  of  personnel, 
it  should  be  known  to  what  extent  the  subjects  are,  or  are 
not  representative  of  the  user  population,  and  in  what  as¬ 
pects  . 

1.  Physical  dimension:  ranges  of  heights  and 

weights  of  test  participants  shall  be  specified, 
and,  where  practicable,  should  not  be  to^  unre¬ 
presentative  the  range  of  5th  to  95th  percentiles 
of  applicable  features  of  the  user  population. 
Determination  shall  be  made  of  specific  bodily 
dimensions  of  importance  for  item  use,  such  as 
reach  or  seated  height 

2.  Sensory  acuity:  all  test  participants  should 

have  had  a  recent  (within  last  12  months)  test  of 
vision  and  audition  where  vision  or  audition  are 
deemed  critical  to  the  test  function.  Minimum 
standards  shall  be  stated  for  each  of  these  sen¬ 
sory  modalities,  depending  on  an  analysis  of  the 
requirements  of  the  tasks  to  be  performed. 

3.  Experience  and  training:  all  test  participants 
should  have  an  acceptable  number  of  years  in  a 
given  military  specialty,  and  have  the  appropri¬ 
ate  training  and  experience  in  the  command  post 
env i ronment . 


Attitude  and  motivation  is  not  an  overriding  issue 
when  military  subjects  are  used,  since  they  are  subject  to 
orders.  However,  they  should  be  given  an  explanation  of 
why  they  are  participating  in  the  evaluation,  and  why 
their  performance  is  important. 


CONTROL  OF  PROCEDURES 

Participants  in  the  evaluation  are  to  perform  accord¬ 
ing  to  standard  procedures,  based  on  agreed  standard  mili¬ 
tary  operating  procedures  and  the  requirements  of  the  eva¬ 
luation.  However,  flexibility  in  experimenting  with  novel 
or  personal  methods  or  work  procedures  could  be  allowed  in 
moderation  under  controlled  conditions.  These  procedures 
are  to  be  issued  by  the  test  evaluator  as  instructions 
during  the  training  sessions  preceding  the  tests.  This 
approach  ensures  more  valid  inferences  being  drawn  from 
test  results  with  regard  to  representative  users. 

When  competitive  items  are  being  compared  in  the  eva¬ 
luation,  the  following  conditions  will  apply: 

1.  Personnel  operating  the  competitive  items  should 
have  comparable  training,  that  is,  personnel 
should  be  cross-trained  on  the  alternatives.  To 
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minimize  the  effects  of  time  of  operation,  the 
evaluation  of  the  alternatives  should  be  conduct¬ 
ed  simultaneously,  facilities  permitting. 
Otherwise,  they  should  be  evaluated  at  similar 
times  of  day  under  the  same  environmental  condi¬ 
tions.  To  further  minimize  sources  of  variabili¬ 
ty,  the  items  should  be  tested  again  by  switching 
the  personnel  from  item  A  to  item  B,  in  a  prede¬ 
termined  counter- balanced  order,  not  simple 
alternation  (ABBA  rather  than  ABAB) . 

2.  All  test  participants  should  be  tested  on  alter¬ 

native  items,  and  under  each  test  condition.  The 
total  group  of  test  participants  will  be  divided 
at  random  into  subgroups,  and  the  order  of  allo¬ 
cation  of  test  items  to  groups  will  be 

counter-balanced  across  groups  as  is  feasible 
within  the  constraints  of  the  exercise. 

3.  Test  project  personnel  should  review  these  plans 
before  conduct  of  the  evaluation  to  ensure  that 
factors  that  could  reduce  the  validity  and  relia¬ 
bility  of  the  results  have  been  eliminated.  A 
careful  review  must  be  made  at  this  time  to  de¬ 
termine  whether  the  test  conditions  to  be  em¬ 
ployed  and  the  test  design  will  provide  unbiased 
data . 


IDENTIFICATION  OF  OPERATOR  TASKS 

Consideration  must  be  given  in  the  preparation  of  the 
test  to  identifying  what  is  to  be  tested  (identification 
of  objectives  and  critical  issues  for  testing) ,  how  the 
test  is  to  be  conducted,  and  what  criteria  are  to  be  used. 

The  tasks  that  are  to  be  analyzed  must  be  identified 
by  the  human  factors  engineer  and  the  test  planner  by  a 
walk-through  of  the  activities  performed  for  specific 
functions,  using  the  actual  equipment,  and  in  conjunction 
with  an  experienced  operator  of  the  equipment.  All  criti¬ 
cal  tasks  would  be  recorded  at  this  stage.  A  walk-through 
involves  the  performing  of  tasks  sequentially  in  an  ana¬ 
lytical  manner  to  identify  potential  human  factors  prob¬ 
lems  in  equipment  design,  environmental  effects,  and  sys¬ 
tem  performance;  to  evaluate  characteristics  of  test  par¬ 
ticipants  (bodily  dimensions,  skills);  to  assess  types  of 
tests  and  measurements  to  be  used;  to  generate  data  re¬ 
quirements;  and  to  identify  facilities  and  instrumenta¬ 
tion  required.  Much  of  this  information  can  be  gained  by 
a  prior  assessment  of  the  manually  operated  system. 
Operator  tasks  will  be  identified  with  more  validity  dur¬ 
ing  the  mini-testbed  evaluation  trials  for  definition  in 
the  evaluation  of  the  testbed  proper. 


-  11  - 

TASK  CRITICALITY 

Task  criticality  is  analyzed  to  identify  tasks  that 
are  critical  or  that  must  be  included  in  the  evaluation. 
Tasks  can  be  classified  as  high  criticality,  moderate  cri¬ 
ticality  or  low  criticality,  and  all  high  and  moderate 
criticality  items  are  included  in  the  evaluation.  The 
criticality  scaling  dimensions  are  as  follows: 

1.  High  criticality.  A  task  is  judged  to  be  of  high 
criticality  if  its  performance,  or  failure  to 
perform  it  properly,  results  in  hazardous  or  un¬ 
safe  conditions,  which  in  terms  of  a  command  and 
control  information  system  would  involve  a  major 
tactical  error,  or  loss  of  important  resources, 

2.  Moderate  criticality.  A  task  is  judged  to  be  of 
moderate  criticality  if  its  performance,  or  fai¬ 
lure  to  perform  it  properly,  results  in  (a)  imme¬ 
diate  or  ultimate  degradation  of  the  system  or 
its  components,  or  immediate  cessation  of  the  op¬ 
eration,  ( b)  reduced  usability  or  inefficient 
performance  of  a  major  component  of  the  equip¬ 
ment,  or  ( c)  unnecessary  difficulty  or  signifi¬ 
cant  loss  of  time  to  the  operator. 

3.  Low  criticality.  A  task  is  judged  to  be  of  low 

criticality  if  its  performance,  or  failure  to 
perforin,  has  no  effect  on  the  performance  of  the 
information  system.  It  may  result  in  minor  inef¬ 
ficiencies  in  the  use  of  system  resources  or  in 
irritation  to  users  of  the  system. 

(Perkins, J.  C.  et  al,  1977) 


The  relevance  of  these  criteria  to  an  information 
system  in  the  battlefield  is  as  valid  as  to  weapons  sys¬ 
tems  or  vehicles.  The  result  of  the  performance  of  a  task 
is  more  immmediate  and  direct  with  such  equipments,  where¬ 
as  with  the  information  system  similar  effects  can  be  ob¬ 
tained  on  the  equipments  due  to  their  activity  being  de¬ 
termined  by  control  directives  based  on  inadequate  or  in- 
nacurate  information. 


PERFORMANCE  REQUIREMENTS 

When  the  critical  tasks  and  task  sequences  have  been 
identified,  an  analysis  shall  be  performed  to  identify 
performance  requirements  associated  with  the  critical 
tasks.  This  shall  answer  the  following  questions: 

1.  Who  performs  the  task? 

2.  What  performance  criteria  apply  to  the  task 
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( time ,  rate  etc) ? 

3.  Are  controls  and  displays  involved? 

4.  What  information  input  is  required  from  other 
personnel? 

5.  What  commands  are  required  from  other  personnel? 

6.  What  potential  errors  are  associated  with  the 
task? 

7.  How  does  the  evaluator  know  that  an  error  has  oc¬ 
curred? 

8.  What  environmental  conditions  (climate,  techni¬ 
cal,  or  equipment)  may  influence  task 
per fo rmance? 

9.  What  conditions  specific  to  the  operation  will 
affect  task  performance  (  body  size,  clothing, 
skill  level) ? 


TEST  PROCEDURES 

The  selection  of  test  procedures  that  are  used  de¬ 
pends  on  the  type  of  test  and  the  item  being  tested. 
There  are  two  types  of  human  factors  engineering  tests 
that  can  be  employed  in  the  evaluation: 

l.  Design  Tests.  These  are  directed  towards  measur¬ 
ing  and  assessing  the  human  engineering  technical 
aspects  of  the  equipment  and  its  design  charac¬ 
teristics. 

The  technical  characteristics  include  the 
mechanical,  thermal,  atmospheric  or  illumination 
environments  created  by  the  item  or  under  which 
the  item  must  be  operated  and  maintained. 

The  design  characteristics  include  the  phy¬ 
sical  dimensions  of  the  item  components  which  are 
used  by  the  operator,  such  as  controls,  labels, 
displays,  communications  equipment,  doors,  han¬ 
dles,  optics,  seats,  documents  or  any  other  ele¬ 
ments  of  the  item  which  are  handled,  controlled, 
adjusted,  avoided,  moved,  read,  communicated  or 
contacted  by  personnel  during  use  of  the  item. 
The  design  characteristics  will  be  assessed  ini¬ 
tially  in  the  critical  design  review  to  be  con¬ 
ducted  by  the  project  personnel  prior  to  formal 
testbed  evaluation,  in  order  to  establish  the  in¬ 
itial  acceptance  of  the  system  for  testing. 
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2.  Performance  Tests.  These  are  concerned  with 
determining  the  adequacy  of  the  man-machine  in¬ 
terface,  and  the  performance  capability  of  the 
operator  when  using  the  item. 

Performance  can  be  assessed  by  direct  meas¬ 
urement  or  can  be  inferred.  Direct  measurement 
of  performance  producing  objective,  quantitative 
measures  of  man-machine  system  performance  capa¬ 
bility  must  be  used.  Qualitative  data  alone  are 
insufficient  for  evaluating  personnel.  When  in¬ 
ferred,  or  subjective  measurement  is  used,  it  can 
be  either  described  analytically  or  can  be  obta¬ 
ined  from  test  participants  by  means  of  question¬ 
naires  or  interviews. 

To  provide  data  when  direct  measurement  is 
not  possible,  and  to  supplement  direct  measure¬ 
ments,  performance  analyses  can  be  conducted,  to 
identify  system  performance  problems.  Examples 
of  these  are  error  likelihood  analysis,  workload 
analysis,  team  interaction  analysis  and  training 
effectiveness  anaysis. 


The  selection  of  particular  tests  within  these  categories 
depends  on  the  type  and  complexity  of  the  item  being  test¬ 
ed  . 


CRITICAL  DESIGN  REVIEW 

The  critical  design  review  will  be  conducted  by  the 
project  personnel  after  initial  delivery  of  the  first 
workstations,  both  for  the  mini-testbed  and,  as  required, 
for  the  testbed.  The  purpose  of  this  review  is  to  assess 
the  acceptability  of  the  structure  and  functioning  of  the 
workstations  for  use  in  subsequent  evaluation  trials.  The 
factors  applicable  to  this  type  of  review  are: 

1.  Design  characteristics 

Purpose.  To  evaluate  the  items  and  item  compo¬ 
nents  in  the  workstation  for  acceptable  physical 
dimensions  and  placement. 

Relevant  tasks  include  the  application  of  the 
criteria  for  controls,  displays,  labels,  work¬ 
space  and  communications  as  outlined  in  the  sec¬ 
tion  below  on  Design  Tests:  Design  characteris¬ 
tics. 

Working  position. 

Purpose.  To  evaluate  the  normal  working  position 
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for  ease  of  entry  and  exit  for  both  normal  and 
contingency  conditions. 

Relevant  Tasks  include  stepping  into  and  out  of 
the  workstation,  tak i ng/ leav i ng  seat,  and  moving 
to/from  standing  operator  position. 

3.  Station  Configuration. 

Purpose.  To  evaluate  the  design  of  components 
and  procedures  for  ease  of  preparing  the  station 
for  use. 

Relevant  tasks  include  selection  of  modes  of  op¬ 
eration,  integration  with  other  operators,  estab¬ 
lishing  command  links,  making  connections,  fol¬ 
lowing  procedures,  communicating  and  interacting 
with  the  support  system. 

4.  Checkout. 

purpose.  To  evaluate  the  configuration  for  ease 
and  reliability  of  verifying  operational  readi¬ 
ness  and  existing  status  of  various  components. 

Relevant  tasks  include  checking  control  settings, 
checking  data  return  quality,  checking  data  re¬ 
turn  format,  checking  lines  and  verifying  opera¬ 
tional  readiness. 

5.  information  Aquisition/Interpretation 

Purpose.  To  evaluate  the  output  of  the  system 
for  the  ability  of  the  user  to  understand  fully 
the  information  presented. 

Relevant  tasks  include  obtaining/monitoring  con¬ 
tinuous  data,  obtaining/  monitoring  discrete 
data,  obtaining/monitoring  status  data,  obtaining 
verification  data,  identifying/ isolating  problems 
and  assessing  requirement  to  modify  operations. 

6.  Adjust  Operations 

Purpose.  To  evaluate  the  system  for  ease  of  use 
of  those  components  that  contribute  to  operation¬ 
al  readiness. 

Relevant  tasks  include  indicating  system  change 
requirements,  adjusting  to  changed  system  confi¬ 
guration,  inputing  discrete  commands,  monitoring 
computer/  communications  systems. 
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DESIGN  TESTS:  TECHNICAL  CHARACTERISTICS 

Environmental  conditions  cannot  be  controlled  to  any 
significant  degree  during  field  exercise.  However,  meas¬ 
ures  must  be  taken  to  establish  the  operating  values  of 
the  environmental  conditions  in  the  workplace  of  the  test 
participants.  it  is  known  that  performance  can  be  ad¬ 
versely  affected  by  changes  in  these  conditions,  or  by  the 
values  of  these  factors  being  outside  of  an  acceptable 
range . 

The  performance  of  the  test  participants  can  change 
or  deteriorate  due  to  changes  in  environmental  factors, 
that  are  not  controllable,  during  the  mini-testbed  and 
testbed  trials.  The  recorded  values  of  these  factors  will 
permit  the  evaluator  to  assess  whether  observed  perfor¬ 
mance  changes  were  due  to  environmental  factors  or  to  some 
aspect  of  the  testbed  design,  and  also  to  annotate  perfor¬ 
mance  records  to  the  effect  that  environmental  conditions 
were  known  to  have  deviated  from  acceptable  limits. 

1.  LIGHTING 

Workspace  lighting  shall  be  assessed  using  standard 
procedures  made  available  to  the  test  project  personnel, 
to  ensure  that  criterion  levels  are  maintained  throughout 
the  different  evaluation  periods.  The  lighting  test  will 
not  require  the  use  of  test  participants.  The  test  evalu¬ 
ator  will  acquire  illumination  levels  falling  on  selected 
workspace  areas,  and  brightness  values  of  displays.  He 
will  perform  comparisons  of  obtained  light  values  with 
criteria  denoting  minimum  allowable  levels. 

The  test  evaluator  will  identify  all  areas  in  works¬ 
tations  where  lighting  could  be  a  problem.  Different 
light  sources  will  be  identified  for  assessement,  and  po¬ 
tential  glare  problems  from  high  levels  of  direct  or  re¬ 
flected  light  will  be  identified. 

The  test  evaluator  will  measure  light  levels  using  a 
photometer,  according  to  a  test  plan,  under  conditions  of 
maximum  and  minimum  illumination  where  light  intensity  is 
controllable.  For  consoles,  several  readings  should  be 
made  in  approximately  one  foot  increments  in  a  grid  pat¬ 
tern  over  the  surface  to  be  assessed.  The  illumination 
readings  will  be  recorded  on  a  data  sheet  reflecting  the 
same  grid  pattern.  Readings  shall  be  made  in  low  and  day¬ 
light  conditions  of  ambient  light. 

To  measure  the  brightness  levels  of  displays  a  spot 
brightness  meter  shall  be  used.  Several  areas  within  each 
display  shall  be  measured  to  identify  hot  spots  or  areas 
of  non-uniform  luminance. 


The  data  will  be  in  the  form  of  illumination  values 
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of  light  falling  on  a  surface  or  area  (in  foot  candles) , 
and  the  brightness  levels  of  illuminated  displays  (in  foot 
lamberts)  . 


2.  NOISE 

The  effects  of  noise  on  performance  can  be 

1.  direct  when  the  noise  field  adversely  affects  the 
test  participant's  ability  to  perform  his  tasks. 

2.  indirect  in  that  noise  generally  leads  to  fatigue 
which  in  turn  can  result  in  performance  decre¬ 
ment. 


The  assessment  of  noise  will  be  made  to  ensure  that 
noise  levels  produced  in  a  test  condition  do  not  impact  on 
speech  intel 1 ig ibil ty  nor  constitute  an  annoyance,  but  do 
meet  aural  non-detectability  criteria. 

Criterion  levels  for  both  steady  state  and  impulse 
noise  shall  be  made  available  to  the  test  evaluator,  and 
shall  be  used  as  a  reference  against  which  test  measure¬ 
ments  can  be  compared. 

1.  Steady  state  noise  is  a  periodic  or  random  varia¬ 
tion  in  atmospheric  pressure  at  audible  frequen¬ 
cies.  The  duration  of  the  variation  exceeds  one 
second,  and  it  may  be  intermittent  or  continuous. 

2.  impulse  noise  is  a  short  burst  of  acoustic  energy 
consisting  of  either  a  single  impulse  or  a  series 
of  impulses.  The  rise  to  peak  pressure  and  the 
slower  decay  to  ambient  pressure  of  a  single  im¬ 
pulse  occur  within  one  second. 


In  the  testbed,  the  primary  area  of  concern  is  steady 
state  noise  in  areas  occupied  by  test  participants.  Tests 
shall  employ  microphones  having  an  essentially  flat  res¬ 
ponse  at  grazing  incidence  (90°)  and  a  flat  frequency  res¬ 
ponse  between  20Hz  and  18kHz.  Sound  level  meters  shall  be 
used  that  conform  to  the  requirements  for  Type  I  as  speci¬ 
fied  by  ANSI  SI. 4.  Octave  band  filter  sets  used  shall 
conform  to  the  requirements  for  Type  E  Class  II  as  speci¬ 
fied  by  ANSI  SI. 11.  Magnetic  tape  recorders  used  shall 
have  a  flat  frequency  response  from  20Hz  to  18kHz  (f/- 
2dB)  . 


Noise  measurement  generally  involves  sampling  and  re¬ 
cording  noise  intensities  over  the  frequency  range  under 
representative  operational  conditions.  The  obtained  noise 
measurements  are  then  compared  with  the  noise  limits  cri- 
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teria.  This  procedure  will  ensure  that  noise  conditions 
are  within  acceptable  ranges  for  all  test  conditions  of 
the  testbed. 

The  data  recorded  shall  include  the  following: 

1.  Test  conditions 

2.  Test  site 

3.  Meteorological  data  (temperature,  humidity,  baro¬ 
metric  pressure) 

4.  Nomenclature,  model  and  serial  number,  and  manu¬ 
facturer  of  all  instruments  used 

5.  Test  personnel 

6.  Microphone  locations 

7.  Sound  levels  in  dB(A),  dB(C) ,  and  in  each  octave 
band. 

8.  Noise  contour  data  (distances  and  directions  from 
the  equipment  at  which  35dB(A)  is  measured. 


3.  TEMPERATURE,  HUMIDITY  AND  VENTILATION 

Since  no  controls  will  be  provided  for  the  regulation 
of  temperature,  humidity  and  ventilation  conditions  in 
testbed  workplaces,  measurements  will  be  taken  of  actual 
conditions  during  test  periods. 

While  the  effects  of  temperature  variations  on  human 
performance  and  physiology  are  not  thoroughly  understood, 
certain  temperature  states  have  been  demonstrated  to  have 
detrimental  effects.  Continued  work  effectiveness  is  com¬ 
promised  with  increasing  complexity  of  the  task  and  by 
added  mental  strain  if  temperatures  remain  at  a  high 
level . 

Additionally,  the  combined  effects  of  temperature, 
humidity  and  ventilation  produce  effects  that  are  differ¬ 
ent  from  those  produced  by  each  factor  individually.  An 
evaluation  of  one  factor  must  therefore  give  consideration 
to  the  other  factors,  and  their  values. 

The  data  collected  shall  be  as  follows: 

1.  Dry  bulb  temperature  at  one  location  within  the 
workplace  for  approximately  each  5  square  feet  of 
floor  space. 
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2.  Humidity  at  the  same  location  within  the  work¬ 
place. 

3.  Air  flow  rate  and  volume  at  the  same  location. 


These  measurements  can  be  obtained  by  the  use  of  thermome¬ 
ters,  humidity  sensors  and  air  flow  rate  sensors. 

DESIGN  TESTS:  DESIGN  CHARACTERISTICS 

The  specification  of  standards  for  the  design  of 
workplace  items  in  the  testbed  is  included  as  a  guide  to 
the  evaluator  in  his  assessment  of  the  testbed  functions. 

It  is  not  the  function  of  the  evaluation  to  assess 
the  degree  to  which  the  testbed  conforms  to  these  human 
engineering  standards.  The  extent  to  which  they  are  not 
met  can  be  used  as  background  information  in  evaluating 
the  performance,  opinions  and  attitudes  of  test  partici¬ 
pants  towards  use  of  the  testbed  features. 

This  listing  of  the  relevant  factors  in  the  design  of 
workplace  items  should  be  used  as  a  guide  by  the  evaluator 
in  determining  what  factors  will  likely  influence  perfor¬ 
mance  and  attitudes  during  test  performance,  and  so  what 
factors  should  be  probed  in  observations,  questionnaires 
and  interviews.  The  evaluation  of  the  mini-testbed  will 
be  valuable  in  determining  these  items. 


1 .  CONTROLS 

Control  are  components  used  to  activate  and  modify  the 
equipment  power  source  and  to  modulate  the  operating  ele¬ 
ment. 

Areas  of  concern  in  controls  design  are 

1.  location  and  arrangement,  including  the  relation¬ 
ship  between  the  control  and  its  associated  dis¬ 
play,  functional  relations  between  controls,  se¬ 
quential  control  operations,  orientation  to  oper¬ 
ator,  and  uniformity  of  push-buttons  in  key¬ 
boards. 

2.  force  and  clearance  requirements,  as  detailed  in 
Annex  A,  Table  IX. 

visibility,  as  it  contributes  to  the  operator's 
ability  to  see  the  control  clearly,  including  lo¬ 
cation,  size,  shape,  colour,  contrast,  field  of 
view,  viewing  distance,  reflectance  and  illumina¬ 
tion. 


3. 


4.  operating  procedures,  as  outline  in  MI L -STD— 1 47 2 , 
paragraph  5.4  (attached  as  Annex  A). 


2 .DISPLAYS 

Displays  are  components  that  provide  visual  and  auditory 
information  to  the  operator  concerning  the  status  of  oper¬ 
ation,  and  can  provide  positive  indication  of  developing 
or  potential  malfunction. 

Areas  of  concern  in  displays  design  include 

1.  location  and  arrangement  of  displays  relative  to 
the  orientation  of  the  operator,  at  a  viewing 
distance  of  33-70  cm. 

2.  visibility,  including  angle  of  display  to  line  of 
sight,  allocation  of  most  frequently  used  display 
sources  in  optimal  visual  zone,  adequate  contrast 
and  luminance,  and  prevention  of  reflections. 

3.  conditions  of  use,  such  as  display  precision  and 
response,  quality  of  information  displayed,  min¬ 
imizing  of  the  requirement  to  decode  information, 
absence  of  trademarks  or  irrelevant  information 
from  display  surface,  uniformity  of  coding  tech¬ 
niques,  and  accessibility  of  material  from 
printers  and  plotters. 


Specifications  will  be  in  accord  with  MIL-STD-1472 ,  para¬ 
graph  5.2  as  appropriate  (attached  at  Annex  B) . 


3.  LABELS,  MARKINGS 

Labels  provide  technical  guidance  in  the  form  of  schemat¬ 
ics  or  instruction  plates,  make  the  operator  aware  of  ha¬ 
zards,  and  give  special  guidance  or  instructions. 

Labellling  and  markings  criteria  will  be  applied  as 
outlined  in  MIL-STD-1472,  paragraph  5.5  (attached  as  Annex 
C)  . 


4.  WORKSPACE 

This  is  the  area  within  which  the  test  participant  oper¬ 
ates  the  equipment.  It  includes  space  for  controls,  dis¬ 
plays,  optics,  electronic  devices,  as  well  as  standing 
areas,  consoles  and  seats.  Storage  for  task-related  and 
personal  items  is  incorporated. 
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Areas  of  concern  for  evaluation  of  the  workplace  include 

1.  location  and  arrangement,  including  placement  of 
displays  in  relation  to  work  surfaces,  placement 
of  controls  with  respect  to  displays  and  work 
surfaces,  profile  and  dimensions  of  consoles, 
seating  design,  and  work  surface  design. 

2.  clearances,  including  knee  clearance  for  seated 
operator,  seat  adjustment  ranges,  and  adequate 
personal  work  space  envelope. 

3.  visibility,  including  reflections  of  items  in 
display  screens,  total  workspace  viewing  angles, 
and  illumination. 

4.  conditions  of  use,  including  environmental  condi¬ 
tions,  safety  considerations  and  possibility  of 
personal  injury. 

5.  operating  procedures,  including  suitable  accessi¬ 
ble  storage  for  manuals  and  worksheets,  worksur- 
faces  for  placement  of  reference  manuals,  and  su¬ 
itable  labeling  and  instructions. 


General  specifications  for  workspace  design  will  be 
in  accordance  with  MIL-STD-1472,  paragraph  5.7  as  appro¬ 
priate,  (attached  as  Annex  D) . 


5.  COMMUNICATIONS 

This  refers  to  devices  and  techniques  for  communicating 
information  among  test  participants  within  the  workspace, 
and  between  these  personnel  and  individuals  externally  lo¬ 
cated.  It  is  recognized  that  the  communications  devices 
used  in  the  evaluations  may  not  be  representative  of  those 
to  be  used  in  an  operational  system.  The  degree  to  which 
the  communications  devices  used  influence  the  perfromance 
or  attitudes  of  the  evaluation  subjects  should  be  noted, 
however . 

Areas  of  interest  include 

1.  location  and  arrangement,  including  availabilty 
of  microphones,  headphones  and  headsets,  accessi- 
bilty  of  volume  and  gain  controls,  and  adjust¬ 
ments  for  earphones  and  headsets. 

2.  clearance,  including  unobstructed  reach  to  com¬ 
munications  controls. 


PERFORMANCE  TESTS 


Performance  assessment  provides  data  that  bear  di¬ 
rectly  on  the  issue  of  operational  effectiveness,  rather 
than  the  assessment  of  equipment  design.  The  initial  aim 
is  the  obtaining  of  gross  measures  at  critical  points  in 
the  system.  If  these  indicate  deficiencies  within  an 
identified  sub-element,  then  additional  performance  meas¬ 
ures  are  examined  to  isolate  procedural,  coordination  or 
communication  problems. 

The  test  scenario  should  sample  a  broad  range  of  ac¬ 
tivities  performed  at  the  workstation.  The  primary  meas¬ 
ure  of  interest  is  the  adequacy  of  the  task  output. 
Conventional  measures  are  time,  accuracy  and  completeness, 
supported  by  stated  operational  requirements  or  perfor¬ 
mance  standards.  These  measures  can  be  obtained  in  large 
part  from  objective  records  of  system  output.  When  ade¬ 
quate  standards  are  not  obtained  by  the  test  participant, 
as  indicated  by  these  objective  records,  diagnostic  meas¬ 
ures  are  required  to  identify  the  nature  of  the  difficul¬ 
ty.  These  diagnostic  measures  may  be  obtained  from  addi¬ 
tional  records  of  control  activation  times,  errors,  ommi- 
sions,  or  from  direct  observation  of  test  participant  per¬ 
formance  and  from  test  participant  interviews. 

Questionnaires  and  interviews  shall  be  carefully  pre¬ 
pared  and  administered  to  gather  valid  and  reliable  data 
reflecting  personnel  opinions  and  insights  concerning 
man-machine  system  performance  capability,  and  military 
utility  and  acceptance.  These  give  opinions,  attitudes 
and  preferences  of  the  users  who  have  experience  with  the 
item,  and  also  supplement  and  clarify  information  derived 
from  observations  and  measurements. 


1.  OBJECTIVE  MEASURES 

Criteria  must  be  established  for  the  collection  of 
objective,  quantitative  data  to  measure  personnel  perfor¬ 
mance.  This  includes  the  issue  of  how  much  data  should  be 
collected.  With  too  little  data  it  is  not  possible  to 
form  valid  conclusions  about  performance.  Collecting  too 
much  data  is  inefficient,  since,  although  the  required 
data  are  available,  it  may  prove  difficult  to  isolate  and 
extract  those  data  from  the  total  amount  collected. 

It  is  possible  to  collect  data  on  all  the  actions 
taken  by  every  test  participant  in  the  evaluation  trials 
while  using  the  data  system.  At  an  extreme  level,  every 
time  that  he  hits  a  key  or  uses  any  other  data  manipula¬ 
tion  device  (tablet  or  roll  ball),  the  action  can  be  re¬ 
corded  and  the  time  of  the  action  noted.  Subsequent  in¬ 
terpretation  of  these  data  can  indicate  correct  responses, 
errors  committed,  and  frequency  of  use  statistics  for  var- 
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ious  functions  and  services. 

The  value  of  these  data  should  be  judged  in  advance, 
to  see  how  meaningful  they  will  be  in  assessing  the  value 
of  the  automated  aids  provided.  An  assessment  will  also 
have  to  be  made  as  to  the  cost  to  the  system  in  terms  of 
overheads  to  record  all  these  data  and  to  store  them  for 
future  recall  and  analysis. 


To  reduce  the 
terpretation  of 
be  made  as  to  the 
during  the  test, 
the  test  evaluator 
data,  files  and  f 
role  under  examina 
types,  of  interest 
graph  3.12,  based 
series. 


load  on  the  system,  and  to  make  the  in- 
the  data  more  meaningful,  selection  must 
operator  functions  that  will  be  recorded 
This  is  a  judgment  that  must  be  made  by 
in  terms  of  the  value  of  the  available 
acilities  to  someone  performing  the  duty 
tion.  Guidance  as  to  the  main  data 
is  given  in  Heckman  et  al  (1979),  para- 
on  the  results  of  the  Exercise  Talfos 


Almost  all  personnel  performance  measures  fall  into 
one-of  three  general  categories: 

4 

1.  accuracy  or  errors 

2.  duration  of  responses 

3.  "reaction  time  to  perform  an  action 

and  these*must  be  applied  to  the  tasks  being  performed  and 
the  equipment  being  operated. 


The  data  collected,  therefore,  will  be 
accuracy,  duration,  reaction  time,  freq 
rence,  and  the  amount  and  quality  achieved, 
if  the  value  of  %he  index  of  messages  was 
records  would  be  made  of  eacii  reference  to 
time  of  each  such  reference,  and  the  action 
subsequent  to  that  reference  (i.  e.  what  h 
basis  of  that  information).  For  the  graphi 
cords  might  be  maintained  of  which  data 
called  up  for  display  while  a  Sitrep  was 
that  is,  what  information  is  useful  in  gra 
completion  of  this  task. 


concerned  with 
uency  of  occur- 
For  example, 
to  be  assessed, 
the  i ndex ,  the 
that  was  taken 
e  did  on  the 
cs  display,  re¬ 
elements  were 
being  prepared, 
phic  form  for 


Status  information  should  be  recorded  in  snapshot 
form,  by  recording  the  values  of  specific  items  on  a  peri¬ 
odic  basis.  For  example,  the  length  of  the  message  queues 
for  the  different  precedence  levels  can  be  sampled  on  a 
5-minute  basis. 


Time  Measures 


T 
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(a)  Reaction  time  measures. 

Reaction  time  measures  should  be  taken  L>  indicate  t.no 
time  taken  for  a  test  participant  to  perceivt  an  event,  or 
to  initiate  an  action  in  response  to  an  event. 

Their  main  value  is  in  determining  how  quickly  the 
test  participant  can  react  to  programmed  events.  The  fol¬ 
lowing  points  must  be  noted: 

1.  reaction  time  data  should  only  be  collected  when 
it  has  been  determined  that  they  will  be  of  use 
for  the  evaluation. 

2.  the  reaction  time  data  will  only  be  meaningful  if 
a  time  requirement  exists,  or  a  reaction  time 
criterion  is  available.  That  is,  there  has  to  be 
a  standard  against  which  the  data  are  compared, 
in  order  to  assign  meaning  for  the  evaluation. 

3.  there  may  be  an  application  for  team  as  opposed 
to  individual  reaction  time  data.  This  type  of 
measure  depends  on  the  accumulation  of  individual 
reaction  times,  together  with  team  interaction 
factors . 

4.  the  test  participant's  response  may  be  covert, 
that  is,  a  perceptual  rather  than  an  observable 
response.  It  may  be  difficult  to  record,  there¬ 
fore. 

5.  if  a  reaction  time  measure  is  used,  the  precision 
of  the  measurement  must  be  appropriate  to  the  na¬ 
ture  of  the  task  being  measured. 


( b)  Duration  measures. 

Duration  measures  should  be  taken  to  indicate  the  total 
time  required  to  complete  a  task. 

The  main  value  of  duration  measures  is  when  there  is 
a  maximum  duration  that  is  considered  to  be  acceptable  for 
a  task.  This  can  relate  to  both  individual  and  to  team 
performance.  When  acceptable  time  durations  are  not  met, 
excessive  demands  may  be  being  made  at  some  point  in  the 
procedure.  When  they  are  met,  it  may  be  at  a  cost  in 
terms  of  decreased  accuracy. 

An  application  for  duration  measures  is  determination 
of  what  percentage  of  time  the  test  participant  spends  on 
individual  functions  when  he  is  performing  several  func¬ 
tions  concurrently  or  sequentially  (for  example,  receiving 
a  message,  logging  it,  extracting  information  from  it,  and 
entering  the  data  in  the  system,  can  be  recorded  by  dura¬ 
tion  of  each  function) . 
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Accuracy  Measures 


Measures  of  the  accuracy,  or  the  converse,  the  errors  com¬ 
mitted  in  task  performance  is  the  most  commonly  used  and 
the  most  useful  measure  of  personnel  performance. 
Accuracy  can  be  measured  in  tasks  that  include  the  follow¬ 
ing  : 


1. 

2. 

3. 

4. 


observing  and  identifying  stimuli 

estimating  distance,  direction  or 
ment  of  objects 

detecting  a  change  in  events  over 

recognizing  a  signal  in  a  high 
backg  round 


or  occurrences 
time  of  move- 

time 

target  density 


5. 


recognizi ng 


an  out  of  tolerance  condition 


<S .  positioning  a  control 


7.  reading  displays 


8.  selecting  among  alternatives 

9.  making  a  coordinated  series  of  movements 

10.  communicating 


The  following  points  should  be  noted  with  respect  to  accu¬ 
racy  measures: 


the 
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accuracy  data 

can 

be 

diagno 

st  i 

c 

o  f 

inad  equa  te 

system  design  or  of  inadequate  personnel  training 

4.  analysis  of  error  data  relates  to  both  error  fre¬ 
quency  and  to  the  types  of  errors  made 

errors  that  are  made  but  are  subsequently  cor¬ 
rected  by  the  test  participant  should  not  be 
counted  as  errors  unless  they  degrade  task  per¬ 
formance  significantly  until  corrected. 


5. 
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For  error  analysis,  therefore,  there  must  be  a  state¬ 
ment  prior  to  the  evaluation  that  clearly  outlines  the 
number  of  errors  allowable,  and  the  types  and  criticality 
of  errors  to  be  assessed.  Errors  that  have  no  impact  on 
overall  performance,  or  are  trivial  in  nature  should  not 
be  recorded.  Without  some  prior  guide  as  to  the  critical¬ 
ity  of  errors  and  their  value  as  data,  the  test  observers 
will  not  be  able  to  recognize  performance  inadequacies  and 
to  note  that  errors  are  being  made. 

The  recording  of  errors  will  be  achieved  in  several 
ways.  Some  of  the  error  data  will  be  logged  automatically 
in  the  computer  as  part  of  the  workstation  activity  re¬ 
cord.  The  preferable  technique  for  manual  error  logging 
is  to  use  an  operating  procedure  as  a  template.  Task  per¬ 
formance  is  checked  against  the  procedure  as  each  action 
is  accomplished.  Actions  that  do  not  conform  to  the  tem¬ 
plate  are  noted  at  that  point  on  the  procedure  sheet. 

For  relatively  unstructured  tasks  this  procedure  may 
comprise  a  list  of  general  functions  rather  than  specific 
actions,  and  only  major  gross  actions  required  to  carry 
out  these  functions  noted.  At  this  level,  the  observer 
has  to  be  more  cognizant  of  the  task  requirements,  and  be 
more  able  to  observe  the  task  details  and  to  note  errors 
in  specific  actions. 

The  data  recorded  should  include  the  nature  of  the 
error,  error  amplitude  if  appropriate,  and  where  in  the 
system  operation  the  error  occurred.  Frequency  of  errors 
of  each  type  will  be  computed  at  a  later  stage. 
Additionally,  accuracy  will  be  assessed  apart  from  error 
data  by  contrasting  the  number  of  tasks  successfully  com¬ 
pleted  against  the  number  attempted. 


Frequency  of  Occurrence  Measures 

Frequency  measures  of  personnel  performance  give  a 
tabulation  of  personnel  actions  over  time,  or  during  some 
specific  phase  of  the  operation.  The  main  value  of  such 
data  is  to  explain  other  data  that  have  beeen  collect c  , 
rather  than  standing  alone  as  a  performance  measure.  y 
itself,  it  explains  nothing.  Relative  frequency  of  errors 
may  assist  in  explaining  a  problem  that  has  been  noted 
with  a  data  entry  device,  for  example.  Commonly,  frequen¬ 
cy  measures  are  carried  out  on  personnel  actions,  errors, 
verbal  reports  or  maintenance  actions. 


Measures  of  Amount  Achieved 


Given  that  a  certain  level  of  performance  must  be 
acieved  on  a  task,  performance  measures  indicate  the  de¬ 
gree  of  achievement  relative  to  that  criterion.  An  exam- 
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pie  is  the  number  of  messages  that  are  processed  from  the 
total  number  that  are  sent  to  a  terminal.  The  previously 
noted  measure  of  accuracy,  i.e.  the  percentage  of  tasks 
that  are  successfully  completed,  is  another  example.  The 
value  of  this  measure  is  largely  descriptive  rather  than 
analytical.  It  can  be  used  in  conjunction  with  other 
measures  to  improve  understanding  of  personnel  perfor¬ 
mance.  A  related  concept  is  the  amount  consumed,  since 
there  is  always  a  cost  associated  with  attaining  a  pro¬ 
duct.  The  measure  of  amount  consumed  in  the  command  post 
task  may  be  man-hours,  computer  system  resources  or  com¬ 
munication  system  time. 


2.  INFERRED  MEASURES 

When  the  measures  that  are  employed  depend  on  human 
judgment,  that  is,  when  the  test  participant  or  observer 
is  the  measuring  instrument,  there  is  inevitable  inaccura¬ 
cy  and  inconsistency.  This  type  of  measurement  will  in¬ 
volve  the  recognition  of  the  behaviour  to  be  recorded,  de¬ 
termination  of  the  relevant  characteristics  of  that  beha¬ 
viour,  and  the  recording  of  the  relevant  data. 
Interpretation,  and  so  error,  is  involved  at  each  of  these 
stages . 

In  practical  terms,  all  measures  of  personnel  perfor¬ 
mance  cannot  be  objective,  and,  indeed,  any  evaluation  is 
incomplete  if  subjective  data  are  not  gathered  together 
with  objective  data,  since  they  provide  information  unob¬ 
tainable  by  other  means.  There  is  value  to  be  derived 
from  the  careful  use  of  inferred  measures.  These  include 
observation,  the  questionnaire,  the  interview,  and  the  use 
of  rating  scales,  checklists  and  critical  incident  report¬ 
ing.  It  should  be  noted  that  qualitative,  subjective 
measures  such  as  these  cannot  be  scaled  nor  combined  with 
other  subjective  data.  They  cannot  stand  alone,  but  must 
be  used  to  support  or  explain  the  meaning  of  quantitative 
data . 


Observation 

Observation  of  subject  activity  during  evaluations 
provides  increased  objectivity,  but  requires  a  large  pool 
of  experienced,  trained  human  factors  specialists  to  act 
as  observers,  since  an  observer  is  required  at  each  sub¬ 
ject  workstation. 

Project  officers  can  observe  more  effectively  from 
the  military  procedures  standpoint,  but  in  most  cases  must 
be  trained  to  observe  behaviour  analytical ly.  Observation 
is  not  merely  seeing,  but  also  includes  analysis  and  in¬ 
terpretation  by  the  selection  of  relevant  task  charac¬ 
teristics.  It  is  this  selectivity,  with  associated  inac- 


curacies  and  omissions  of  observation  that  can  be  identi¬ 
fied  as  a  key  issue  in  the  use  of  this  measurement  techni¬ 
que  (Selltiz  et  al,  1959). 

If  observation  is  conducted  by  remote  means,  such  as 
by  videorecording,  the  presence  of  the  camera  may  act  as  a 
reminder  of,  and  add  to  the  artificiality  of  the  situa¬ 
tion.  The  cost  of  the  equipment  for  data  collection  by 
such  remote  observation  in  a  large  system  could  be  quite 
considerable.  The  time  required  and  the  professional 
staff  dedicated  to  the  reduction  of  this  form  of  data  is 
often  unacceptable. 

There  are  several  problems  associated  with  the  use  of 
human  observers: 

1.  There  is  a  lack  of  reliability  resulting  from 

random  observation  of  events  and  selective  per¬ 
ception  on  the  part  of  the  observers. 

Establishing  formal  procedures  can  alleviate  this 
to  a  degree,  but  personal  interest  or  training 
can  still  influence  how  the  observer  observes. 

2.  The  mere  presence  of  the  observer  can  alter  the 
performance  of  the  test  participants  from  what  it 
would  otherwise  have  been. 

3.  There  is  a  risk  that  the  observer  may  not  notice 
important  actions,  such  as  erroneous  responses, 
if  the  test  participant' s  body  blocks  the  ob¬ 
server'  s  view  of  his  actions.  If  events  occur 
concurrently  or  in  rapid  succession,  the  observer 
may  be  unable  to  detect  them  all.  He  may  then 
focus  on  a  sub-set  of  events,  or  alternatively 
only  report  in  a  gross  undetailed  manner. 

4.  It  is  usual  for  an  observer  to  have  a  certain 
status  or  role  in  the  organization  that  precludes 
him  from  observing  the  behaviour  of  the  more  sen¬ 
ior  participants.  The  captain  will  find  it  dif¬ 
ficult  to  properly  observe  the  general. 

5.  An  observer  allocated  to  observe  a  specific  group 
tends  to  become  involved  with  the  group,  identi¬ 
fying  himself  as  a  member  of  the  group.  In  the 
process  he  loses  objectivity. 

6.  The  process  of  observing  implies  that  the  ob¬ 
server  must  passively  wait  for  the  occurrence  of 
particular  events.  The  most  interesting  events, 
or  the  events  that  will  be  most  informative  about 
performance  may  not  occur  during  the  time  span  of 
the  observation. 
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These  limitations  to  the  observation  technique  are 
not  sufficient,  however,  to  eliminate  it  from  use.  The 
natural  setting,  the  amount  of  information  that  can  be  ob¬ 
tained  on  a  wide  range  of  items,  and  the  relative  unobtru¬ 
siveness  of  the  technique  makes  it  a  useful  and  valuable 
method  of  data  collection.  The  problems  should  be  recog¬ 
nized,  however,  and  their  effects  minimized  as  much  as 
possible. 

The  procedure  for  individual  observation  of  personnel 
performance  can  be: 

1.  describe  what  events  or  test  participant  res¬ 
ponses  occurred,  what  happened,  who  did  it,  and 
with  whom. 

2.  determine  the  frequency  of  system  events  or  test 
participant  responses 

3.  determine  the  accuracy  (or  errors)  with  which 
these  events  or  responses  occurred 

4.  form  conclusions  and  judgments  about  performance 
qual ity 


Questionnaires 

The  questionnaire  involves  a  series  of  structured 
questions  presented  to  test  participants  in  order  to  sam¬ 
ple  their  opinions,  attitudes  and  preferences  concerning 
test  facilities  or  procedures.  Participants  are  usually 
required  to  rate  the  item  along  some  dimension  ranging 
from  extremely  positive  to  extremely  negative.  The  major 
advantage  of  the  questionnaire  is  that  it  can  be  administ¬ 
ered  to  a  group  of  test  participants  simultaneously,  while 
in  addition  it  elicits  responses  while  placing  a  minimum 
demand  on  the  test  participant.  The  major  disadvantage  is 
that  only  those  issues  that  have  been  determined  in  ad¬ 
vance  by  the  test  evaluator  as  being  important  are  sam¬ 
pled  . 


(a)  Preparation  of  Questionnaires. 

Questionnaire  items  should  be  based  on  a  prior  human  fac¬ 
tors  analysis  by  specifically  addressing  each  potential 
problem  area  which  the  analysis  identifies.  The  responses 
to  the  questionnaire  will  then  tend  to  confirm  or  reject 
initial  assessments,  and  may  indicate  potential  practical 
solutions  to  identified  problems. 


(b)  Validity. 

Validity  implies  that  the  questionnaire  is  measuring  what 


it  is  intended  to  measure.  Frequently  it  is  assumed  that 
the  questions  are  asking,  and  so  giving  data  on  one  issue, 
when  in  fact  the  answers  are  about  something  else,  since 
the  subjects  give  a  different  interpretation  to  the  ques¬ 
tion  than  was  intended. 

A  major  point  is  the  establishing  of  content  validity 
for  each  question.  The  designers  of  questionnaires  often 
assume  that  the  way  they  have  phrased  questions  is  correct 
because  they  understand  them.  The  subject,  however,  may 
not  give  answers  in  the  frame  of  reference  intended,  since 
he  may  misunderstand  the  wording,  may  confuse  the  point 
with  some  other,  or  may  answer  in  an  unexpected  sense.  It 
is  important,  therefore,  to  pre-test  the  questionnaire  to 
ensure  that  the  questions  are  meaningful  and  understand¬ 
able,  and  to  provide  information  on  any  problems  in  con¬ 
tent,  presentation  or  procedures  that  may  have  been  over¬ 
looked  to  this  point.  The  pretest  should  be  conducted  on 
personnel  similar  to  the  test  subjects,  and  the  data  that 
is  gathered  should  be  used  only  for  the  purpose  of  questi¬ 
onnaire  refinement. 


(c)  Question  Construction. 

Questionnaire  items  must  be  developed  with  care.  Firstly, 
the  length  of  the  questionnaire  should  be  as  short  as  pos¬ 
sible  while  covering  the  required  topics.  Secondly,  the 
questions  should  be  such  as  to  elicit  answers  that  will  be 
of  value  in  assessing  the  item  rather  than  providing  back¬ 
ground  information.  Thirdly,  the  phrasing  of  the  question 
must  not  bias  the  answer  in  one  direction  or  the  other. 
Finally,  the  questions  must  be  as  clear  and  concise  as 
possible. 

Questions  must  be  constructed  in  such  a  way  that  they 
ask  only  one  question  on  a  defined  and  specific  point,  so 
that  the  answer  can  be  interpreted  correctly.  That  is, 
compound  questions  must  be  avoided. 

The  recommended  format  for  questions  is  the  presenta¬ 
tion  of  fixed  alternatives  from  which  the  subject  selects 
his  response,  while  giving  him  the  option  of  appending  a 
short  explanation  if  he  so  wishes.  The  use  of  free-answer 
questions  is  not  recommended,  although  they  offer  some  ad¬ 
vantages  such  as  being  undirected,  and  eliciting  a  wide 
variety  of  responses.  They  also  provide  a  richer  back¬ 
ground  of  opinion  on  which  to  base  conclusions.  Their 
main  application,  however,  is  in  situations  where  the  is¬ 
sues  are  unclear  and  formulation  of  specific  questions 
difficult.  These  advantages  are  outweighed  by  the  possi¬ 
bility  that  the  opinions  presented  are  being  influenced  by 
the  observer.  The  administrative  problems  involved  in  an¬ 
alysis  of  the  information  given  to  free-answer  questions 
are  alone  severe  enough  to  make  them  unusable. 


In  designing  questions,  it  must  be  ensured  that  the 
subject  can  in  fact  provide  the  information  that  is  re¬ 
quested.  If  not,  he  may  answer  anyway,  from  a  position  of 
ignorance.  This  does  not  imply  that  the  respondents  to 
the  questionnaire  are  not  knowledgable  about  the  task,  but 
rather  that  they  are  being  asked  to  report  on  their  own 
behaviour  or  attitudes  from  memory.  They  may  not  have 
noted  these  items  in  enough  detail  to  report  adequately  at 
a  later  time. 


(d)  Administration. 

The  time  when  the  questionnaire  is  administered  during  the 
evaluation  is  important.  If  it  is  given  too  early,  the 
subjects  may  not  have  had  enough  experience  to  give  mean¬ 
ingful  answers.  If  it  is  given  too  late,  the  risk  is  run 
that  the  subjects  adapt  to  system  deficiencies  before 
their  opinions  are  noted. 

Interviews 

(a)  Interview  Structure. 

The  interview  provides  a  maximum  amount  of  information  in 
terms  of  insights  and  acceptability  estimates.  It  may  be 
administered  on  an  individual  basis,  and  so  takes  a  lot  of 
time  to  administer,  depending  on  the  number  of  inter¬ 
viewers  and  interviewees.  It  may  be  administered  to  a 
team,  with  one  interviewer  interviewing  several  inter¬ 
viewees  as  a  group,  in  order  to  identify  team  interaction 
factors.  The  interview  should  always  be  conducted  at  the 
end  of  the  test  trial. 

The  interview  cannot  be  used  as  an  unstructured, 
open-ended  discussion  period  between  the  test  participant 
and  the  observer.  In  order  to  ensure  that  the  topics  dis¬ 
cussed  by  different  participants  are  comparable,  and  also 
that  the  problem  areas  identified  by  the  test  evaluator 
are  considered,  the  interview  must  follow  a  structured  in¬ 
terview  guide,  containing  a  set  of  questions  which  are 
asked  of  each  participant. 

The  structured  interview  guide  comprises  a  series  of 
questions  selected  on  the  basis  of  their  relative  impor¬ 
tance  for  the  item  assessment.  The  same  series  of  ques¬ 
tions  are  presented  to  each  participant,  nomally  in  the 
same  order. 

A  sample  list  of  items  for  the  interview  can  be: 

1.  what  did  he  do  while  performing  the  task? 

2.  why  did  he  perform  as  he  did? 

3.  what  knowledge  does  he  have  about  principles  and 
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information  that  should  have  guided  his  task  per¬ 
formance? 

4.  what  test  conditions  affected  his  task  perfor¬ 
mance  most,  and  why? 

5.  how  well  did  he  think  he  performed? 

6.  with  what  tasks  did  he  experience  the  most  diffi¬ 
culty? 

7.  in  team  operation,  how  was  responsibility  as¬ 
signed? 

8.  what  effect  did  specific  features  of  the  system 
design  or  function  have  on  his  performance? 

9.  what  comments  does  he  have  to  make  on  any  aspect 
of  the  test  or  on  his  performance? 

(b)  Interviewers. 

Interviews  can  be  conducted  by  the  project  officers  or-*  by 
human  factors  specialists.  Unfortunately  there  are  lim’" 
tations  in  both  approaches. 

The  project  officer  is  familiar  with  the  operational 
requirements  and  procedures,  but  is  not  trained  in  the 
techniques  of  interviewing.  The  main  objections  to  the 
use  of  interviews  are  relevant  here.  Interviews  are  cla¬ 
imed  to  produce  inaccurate  information  due  to  bias  in 
judgment  related  to  the  interviewer's  response  to  the  in¬ 
terviewee's  appearance,  manner,  or  other  personal  charac¬ 
teristics.  In  the  testbed  situation,  this  bias  can  be 
augmented  by  attitudes  towards  the  interviewee  as  an  indi¬ 
vidual  known  personally  or  by  reputation,  to  his  "IOC  that 
is  different  from  that  of  the  interviewer,  or  to  regimen¬ 
tal  differences. 

The  human  factors  specialist  is  skilled  in  interview 
techniques,  but  will  not  be  so  aware  of  the  military  as¬ 
pects  of  the  situation.  The  interviewer,  however,  need 
only  know  the  general  task  procedures,  without  being  as 
proficient  in  the  task  as  the  test  participant.  The  spe¬ 
cialist  will  not  be  alert  to  deviations  from  accepted 
standards  of  procedure  and  technique  as  would  the  project 
personnel . 

Ideally,  all  test  participants  in  the  evaluation 
should  be  interviewed,  but  the  staff  required  to  conduct 
such  a  number  of  interviews  is  beyond  the  resources  of 
this  evaluation.  Some  compromise  may  be  found  between  the 
need  from  a  comprehensive  series  of  interviews  and  the 
number  of  interviewers  available  by  identifying  a  selected 
sample  of  key  subjects  from  each  unit  or  sub-unit  who 


could  provide  the  necessary  data. 

The  basic  requirements  for  interviewers  are: 

1.  Experience  in  establishing  rapport  with  the  per¬ 
son  interviewed 

2.  Being  alert  to  partial  hints  from  the  person  in- 
terv iewed 

3.  Being  able  to  initiate  new  channels  of  communica¬ 
tion  within  the  format  of  the  stuctured  interview 
guide . 

(c)  Guidelines. 

A  series  of  guidelines  for  interviewing  is  as  follows  : 

1.  Decide  in  advance  what  is  to  be  accomplished  in 
the  interview.  This  entails  the  clear  under¬ 
standing  of  what  the  aim  of  the  testbed  evalua¬ 
tion  is,  and  what  the  individual's  role  in  it  is. 
On  this  basis,  the  interview  can  attempt  to  find 
out  the  attitudes  of  the  individual  towards  the 
total  system,  and  to  his  role  in  it.  He  can  also 
be  prompted  to  state  how  well  he  thinks  the  situ¬ 
ation  was  designed  to  permit  him  to  do  what  he 
had  to  do. 

2.  Know  the  interviewee.  The  interviewer  should 
know  in  advance  who  he  will  be  talking  to,  what 
his  operational  background  is,  and  what  his  role 
was  in  the  evaluation.  Rapport  suffers  when  the 
interviewee  is  treated  like  one  of  a  faceless 
crowd . 

3.  Appointments  must  be  made  in  advance  for  each  in¬ 
terview.  The  attitude  of  the  interviewees  to¬ 
wards  the  interview  situation  can  be  negative  and 
uncooperative  if  there  is  an  appearance  of  lack 
of  organization. 

4.  Provide  for  privacy  during  the  interview  session, 
and  establish  clearly  that  all  records  made  from 
the  interview  are  coded  for  analysis  only,  and 
are  otherwise  anonymous. 

5.  Try  to  discount  personal  prejudices,  and  to  take 
the  interviewee's  point  of  view.  Essentially, 
this  means  being  ready  to  listen  to  what  is  said, 
and  interpret  it  in  the  way  it  was  intended,  and 
not  on  the  basis  of  personal  perceptions. 

6.  Allocate  enough  time  for  the  interview  to  be  con¬ 
ducted  thoroughly,  but  keep  it  moving,  avoiding 
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irrelevant  topics.  Approximately  20  minutes  is  a 
good  average  length  for  the  interview  session, 
since  after  30  minutes  interviewees  will  tend  to 
become  fatigued. 

7.  Use  an  interview  guide  or  schedule  as  a  basis  for 
the  structure  of  the  interview.  Each  person  in¬ 
terviewed  should  be  treated  in  as  similar  a 
manner  as  possible,  and  should  be  given  standard 
conditions  within  which  he  provides  information. 
The  interviewer  can  best  avoid  omitting  items 
from  the  discussion,  or  from  introducing  unique 
items  by  following  a  guide  or  loosely  structured 
schedule,  listing  the  topics  that  should  be  co¬ 
vered  in  the  interview. 

8.  At  the  close  of  the  interview,  note  casual  re¬ 
marks  that  provide  additional  information  or  new 
leads.  Individuals  tend  to  follow  the  lead  of 
the  interviewer  up  to  this  point,  trying  to  do 
what  is  requested  of  him.  When  he  realizes  that 
the  procedure  is  coming  to  an  end,  he  is  likely 
to  offer  comments  that  he  was  unable  or  unwilling 
to  offer  within  the  structure  of  the  interview 
proper . 


Critical  Incidents  Measures 

A  critical  incident  is  an  unusual  event  that  occurs 
during  system  operation  and  that  shows  some  positive  or 
negative  feature  of  the  system.  It  generally  refers  to 
some  task- related  action  taken,  or  not  taken  by  the  test 
participant.  An  example  is  a  procedure  that  is  set  up  to 
be  used  in  the  event  of  some  set  of  conditions  occurring. 
It  may  then  be  noted  by  an  observer  that  an  incident  oc¬ 
curs  invoking  the  set  of  conditions,  but  the  test  partici¬ 
pant  being  observed  fails  to  adopt  the  procedure. 

The  critical  incident  is  assumed  to  be  significant, 
but  unusual,  and  to  reflect  test  participant  performance. 
The  method  of  recording  the  critical  incident  is  a  narra¬ 
tive,  and  an  interview  may  be  required  with  the  test  par¬ 
ticipant  in  order  to  clarify  the  details  of  the  event. 


Rating  Scales 

Ratings  can  be  made  by  an  observer,  by  a  team  super¬ 
visor,  by  peers  or  by  the  test  participant  as  a 
self-report  rating.  Ratings  assign  a  number  to  a  subjec¬ 
tive  assessment  so  that  it  can  be  treated  quantitatively, 
but  that  process  does  not  make  the  measurement  more  accu¬ 
rate  nor  more  valid. 


Ratings  should  only  be  used  when  an  objective  measure 
of  performance  assessment  cannot  be  applied,  or  when  such 
a  measurement  would  be  too  costly  or  impractical.  The 
limitations  noted  for  the  observational  technique  apply  to 
ratings,  insofar  as  an  individual  is  the  measuring  instru¬ 
ment  . 

The  graphic  rating  scale  is  the  most  popular. 
Commonly  it  is  a  straight  line  combined  with  descriptors 
that  represent  the  values  of  the  variable  being  scaled. 
The  line  can  be  segmented  into  units  or  can  be  continuous, 
although  a  continuous  line  has  been  found  to  be  preferable 
in  many  cases.  Examples  of  rating  scales  that  could  apply 
to  the  evaluation  are  attached  as  Annex  E. 

Descriptive  terms  that  are  used  should  be  short,  sim¬ 
ple  and  unambiguous,  and  should  be  obviously  consistent 
with  the  attribute  being  rated.  Good/bad  or 
desi rable/undesi rable  descriptors  should  be  avoided. 

It  should  be  noted  that  observers  rating  other  per¬ 
sonnel  tend  towards  leniency  with  those  they  know,  and  are 
subject  to  a  halo  effect  by  rating  a  quality  as  unjustifi¬ 
ably  high  if  other  qualities  were  found  to  be  high.  There 
is  also  a  central  tendency,  that  is,  a  tendency  for  raters 
to  bunch  ratings  in  the  middle  range  of  the  line,  avoiding 
the  extremes. 


Checkl ists 

A  checklist  is  a  series  of  statements  describing  test 
participant  performance,  the  equipment  configuration  and 
the  system  operation.  The  statement  provides  a  standard 
against  which  the  item  is  compared,  to  allow  a  judgment  to 
be  made  as  to  whether  it  is  or  is  not  as  stated. 

A  common  application  is  the  assessment  of  relatively 
static  system  features,  as  in  a  human  engineering  check¬ 
list  of  the  man-machine  interface.  It  is  not  as  useful 
for  the  measurement  of  performance,  since  performance  is 
essentially  continuous  and  checklists  are  binary.  The  use 
of  checklists  will  be  most  appropriate,  therefore,  in  the 
critical  design  review  stage.  It  can  be  applied  during 
the  evaluation  as  a  method  of  monitoring  workstation  and 
environmental  conditions  to  note  deviations  from  the  nor¬ 
mal,  established  conditions  of  the  test. 

The  limitations  in  the  use  of  the  checklist  should  be 
noted.  The  checklist  statement  states  the  required  condi¬ 
tion,  and  the  response  is  that  this  condition  does  or  does 
not  exist.  No  intermediate  state  can  be  noted.  Therefore 
the  statement  must  be  limited  in  its  application,  must  be 
precise  and  should  refer  to  a  single  item.  A  stateinnt 
such  as  'controls  are  simple  and  easy  to  operate'  raises 
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the  question  as  to  the  meaning  of  'simple'  and  of  'easy  to 
operate'.  It  also  does  not  allow  for  the  situation  where 
all  the  controls  except  one  are  deemed  easy  to  operate. 

Checklist  data  are  descriptive.  They  can  only  guide 
the  test  evaluator  to  the  characteristics  that  may  require 
improvements. 


TACCDAS  TESTBED  MEASURES  OF  EFFECTIVENESS 

In  order  to  adequately  assess  the  performance  of  the 
personnel  using  the  TACCDAS  Testbed,  measures  of  human 
performance  effectiveness  have  been  generated  as  a  guide 
for  the  test  evaluator. 


1.  Evaluate  the  operational  effectiveness  and  suita¬ 
bility  of  the  TACCDAS  Testbed,  through  its  integ¬ 
rated  hardware,  software,  procedures  and  person¬ 
nel,  to  support  the  operations  activities  of  re¬ 
ceipt,  evaluation,  correlation,  analysis,  dis¬ 
play,  storage,  retrieval,  production  and  dissemi¬ 
nation.  These  activities  are  conducted  in  sup¬ 
port  of  command  post  personnel  in  accomplishing 
the  mission  of  providing  complete,  accurate,  and 
timely  information  in  support  of  Brigade  opera¬ 
tions  . 


2.  Evaluate  the  capability  of  the  TACCDAS  Testbed  to 
provide  effective  automated  assistance  to  command 
post  personnel  in  the  performance  of  their  du¬ 
ties. 

For  example; 

Proportion  of  enemy  sighting  reports  tthat 
reach  CP  and  are  displayed 
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project  management,  scientif 
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operating  adequacy  of 
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flow 

For  example: 

1.  Amount  of  duty  officer  time  devoted  to  cleri¬ 
cal  duties,  which  detracts  from  his  ability 
to  supervise  and  control  the  CP,  and  to  ad¬ 
vise  the  commander  and  other  staff  cells. 

2.  Currency  of  master  battle  map,  which  should 
reflect  near  real-time  information. 

- 

3.  Reliability  of  master  battle  map,  possibly  in 
terms  of  the  amount  of  information  that  is 
available  to  a  HQ  that  is  displayed  in  that 

HQ. 

4. 

Determine  system  throughput  in  total,  and  for 
each  CP  cell,  in  terms  of  number  of  messages 
logged,  number  of  data  base  transactions,  and 
number  of  final  actions  posted  per  unit  of  time. 

Data  messages  are  seen  to  be  short,  general¬ 
ly  formatted,  with  specific  items  of  information, 
and  requiring  specific  procedures  to  be  followed. 

Since  the  rate  is  largely  determined  by  enemy  ac¬ 
tivity,  their  processing  determines  how  well  the 
commander  is  informed. 

5. 

Determine  by  comparative  analysis  the  relative 
improvement  provided  by  the  TACCDAS  Testbed  for 
report  composition  in  terms  of  time  saved,  accu¬ 
racy,  and  completeness  achieved.  Determine  over¬ 
all  flexibility  of  format  and  ease  of  manipula¬ 
tion  of  data  withion  the  report. 

6. 

Determine  by  observation  and  interview  the  over¬ 
all  adequacy  of  the  non-digital  data  base  in 
terms  of  type  and  amount  of  documents  provided 
and  their  usability. 

t 

7. 

Evaluate  the  technical  coverage,  accuracy  and 
usability  of  all  user  manuals,  technical  orders, 
and  position  handbooks  in  their  support  of  the 
operation  and  maintenance  of  the  Testbed. 

8. 

Determine  the  capability  of  the  TACCDAS  Testbed 
to  provide  automated  support  to  generate  and  ma¬ 
intain  a  digital  and  non-digital  data  base  file 
that  can  be  manipulated  both  manally  and  automat¬ 
ically  so  as  to  maintain  currency  and  effective¬ 
ness  in  support  of  the  primary  mission. 

1 

1 

9. 

Determine  the  efficiency  of  data  base  maintenance 

J 
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in  terms  of  personnel  required  and  man-hors  ex¬ 
pended  for  the  basic  updating  and  purging  func¬ 
tions  . 

10.  Determine  the  adequacy  of  the  data  base  structure 
in  terms  of  elements  to  be  deleted  or  added  to 
facilitate  performance  of  CP  personnel. 

11.  Determine  the  requirement  for,  and  feasibility  of 
an  automated  update  capability  with  respect  to 
certain  files  of  data. 

12.  Determine  the  adequacy  of  system  and  application 
software  in  its  operating  environment.  Identify 
and  catalogue  all  deficiencies  and  discrepancies 
for  further  testing  and/or  corrective  action. 

13.  Evaluate  the  degree  to  which  performance  of  CP 
personnl  is  adversely  affected  by  various  types 
of  system  degradation,  with  resulting  reconfigu¬ 
ration,  input/output  loading,  and/or  partial  loss 
of  automated  assistance  capability. 

14.  Determine  TACCDAS  communications  interface  re¬ 
quirements 

User  opinion  on: 

requirement  for  intercom 
number  and  types  of  rad ios/ remotes 
number  and  types  of  telephones 
possible  enhancements  to  communications  (types 
of  microphones , headsets , alarms)  . 

The  communications  loading  during  peak  peri¬ 
ods  is  mostly  a  system  rather  than  performance 
measure,  but  is  related  to  user  performance  inso¬ 
far  as  it  influences  the  ability  to  pass  informa¬ 
tion  in  a  timely  manner. 

15.  Determine  whether  human  engineering,  biomedical, 
and  safety  objectives  have  been  implemented  ef¬ 
fectively  in  the  design  and  fabrication  of  the 
TACCDAS  Testbed  workstations. 

16.  Determine  the  space  adequacy  within  the  shelters 
for  storage  of  equipment,  personal  gear,  and  for 
the  storage  and  use  of  maps. 

17.  Evaluate  the  maintanabil ity  and  reliability  of 
the  TACCDAS  Testbed  as  supported  by  spares,  test 
and  fault  isolation  equipment  to  permit  continu¬ 
ous  operations. 

18.  Determine  the  ability  of  military  personnel  to 
assemble  and  disassemble,  connect,  interconnect 
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and  disconnect  the  terminal  equipment,  and  to  in¬ 
itiate  operations. 

19.  Obtain  data  and  observations  to  support  recommen¬ 
dations  concerning  the  number,  type  and  skill 
level  of  personnel  required  for  effective  opera¬ 
tion  and  maintenance  of  the  Testbed. 

20.  Obtain  data  and  observations  to  support  recommen¬ 
dation  concerning  the  type,  length  and  content  of 
specific  training  required  for  TACCDAS  operating 
personnel.  Identify  any  contractor-provided  tra¬ 
ining  that  will  facilitate  the  development  of 
military  courses. 

21.  Determine  the  cost  of  ownership  of  a  TACCDAS  con¬ 
figuration  with  regard  to  manpower  requirements 
to  operate  and  maintain  it,  with  manuals,  support 
equipment,  test  equipment,  spares,  training  and 
data  base  conversion. 
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5. 4. 3. 1.3.1  Application  -  Art .ingements  of  push  buttons  mi  the  form  of 
keyboards  should  be  used  when  alphabetic,  numeric  or  special  function 
information  is  to  tie  entered  into  a  system. 


5. 4. 3. 1.3. 2  layout  and  Configuration  -  Ihe  key  configuration  and  the 
number  of  keys  are  directly  dependent  upon  the  predominant  type  of 
information  to  be  entered  into  the  system.  The  major  forms  that 
keyboards  can  take,  which  aid  in  the  entry  of  such  information,  are 
given  below: 


a.  N*JWieric_  Keyboard:  The  configuration  of  the  keyboard  which 
shall  be  used  to  enter  solely  numeric  information  should  be  a  3  x  3  +  1 
matrix  with  the  zero  digit  centered  on  the  bottom  row. 

b.  Alpha-Numeric  Keyboard:  Keyboard  configurations  for  applica- 
tions  which  require  the  entry  of  alphabetic  and  some  numeric  information 
shall  conform  to  MIL-STD-1280.  For  some  applications  the  entry  of  data 
varies  from  primarily  alphabetic  to  primarily  numeric.  For  these  appli¬ 
cations  two  alternatives  are  suggested.  The  first  being  to  provide  a 
keyboard  of  the  type  shown  in  Figure  2,  page  16,  of  MIL-STD-1280  (where 
there  is  no  separation  between  alphabetic  and  numeric  characters);  and 
the  second  to  provide  a  separation  to  emphasize  the  two  separate  func¬ 
tions,  with  the  numeric  keyboard  located  to  the  right  of  the  standard 
keyboard. 

5. 4. 3. 1.3. 3  Dimensions,  Resistance,  Displacement,  and  Separation  -  The 
control  dimensions,  resistance,  displacement  and  separation  between 
adjacent  edges  of  the  pushbuttons  which  form  keyboards  shall  conform  to 
the  criteria  in  Table  IX.  For  a  given  keyboard  these  criteria  shall  be 
uniform  for  all  individual  keys.  For  those  applications  where  operation 
while  wearing  (trigger  finger)  arctic  mittens  is  required,  the  minimum 
key  size  shall  be  0.75  inch  (19  mm).  Other  parameters  are  unchanged 
from  those  of  bare-handed  operation  (see  Table  IX). 

5. 4. 3. 1.3. 4  Slope  -  All  nonportable  keyboards  should  have  a  slope  of 
between  15  and  25  degrees.  The  preferred  slope  is  16  to  17  degrees. 

The  slope  of  a  portable  device  can  be  varied  according  to  the  preference 
of  the  operator. 
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TABLE  IX.  K^.YBOAHDS 


Dimensions  1 

Resistance  1 

Diameter 

D- 

Bare 

handed 

Arctic 

mittens** 

Numeric 

Alpha¬ 

numeric 

Dual 

Function 

Minimum 

0  385” 

0.75" 

3.5  oz 

0  9  02 

0.9  oz 

Maximum 

0.75" 

14.0  02 

6.3  02 

5.3  oz 

Preferred 

0.5" 

0.75" 

Displacement  j 

Separation 

Numeiic 

Alpha 

numetic 

Dual 

F  unction 

(between  adjacent  key  tope) 

Minimum 

0.03" 

0.06" 

0.03" 

0.25"  I 

Maximum 

0.19" 

0.25" 

0.19" 

Preferred 

0.25"  | 

I  Dimensions 

|  Resistance  I 

Diameter 

D* 

Bare¬ 

handed 

Arctic 

mittens** 

j  Numeric 

Alpha¬ 

numeric 

Dual 

Function 

Minimum 

10mm 

19mm 

IN 

250  mN 

250  mN 

Maximum 

19mm 

4N 

1.5  N 

1.5  N 

Preferred 

13mm 

19mm 

j  Displacement 

Separation 

Numeric 

Alpha- 

numeric 

Dual 

Function 

(between  adjacent  key  tope) 

Minimum 

0.8mm 

1.3mm 

0.8mm 

6.4mm  j 

Maximum 

4.8mm 

6.3mm 

4.8mm 

Preferred 

L 

6.4mm .  j 

*Sm  Figure  9 
••Trigger  finger  type 
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DIMENSIONS 

RESISTANCE 

DISPLACEMENT 

Diameter 

D 

A 

Fingertip 

Thumb  or  Heel 

F  mgertip 

Little  Finger 

Thumb  or  F mger 

Operation 

ol  Hand  Operation 

Operoi  ion 

Operation 

Operation 

Minimum 

0.38b"  (lOinin) 

0  15"  (19mm) 

10  or  (2  UNI 

S  or  (1.4N) 

0.125"  (3mm) 

Moximum 

0  75”  (19 inin) 

40  or  (11  ON) 

20  or  (5.6N) 

1.5"  (38mm) 

SEPARATION 

V 


Single  Finger 

Single  Fmger 

Operation  by 

Operation 

Sequential  Operation 

Stxral  Finger* 

Minimum 

0.5"  (13mm) 

0.25"(6nmi| 

0  5"  (13mm) 

Preferred 

2.0"  (bOmml 

1.00"  (25mn>) 

0.5"  (13mm) 

Figure  9.  PUSHBUTTONS  (FINGER  OR  HAND  OPERATED! 
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5.2  VISUAL  DISPLAYS  - 

5.2.1  General  -  Visual  displays  should  be  utilized  to  provide  the 
operator  with  a  clear  indication  of  equipment  or  system  conditions 
for  operation  under  any  eventuality  commensurate  with  the  operational 
and  maintenance  philosophy  of  the  system  under  design. 

5. 2. 1.1  Display  Illumination  -  When  the  degree  of  dark  adaptation 
required  is  not  maximum,  low  brightness  white  light  (preferably  inte¬ 
gral),  adjustable  as  appropriate,  shall  be  used;  however,  when  the 
maximum  degree  of  dark  adaptation  is  required,  low  brightness  red 
light  (greater  than  620  nm)  shall  be  provided.  Where  multiple  displays 
are  grouped  together,  the  displays  shall  have  brightness  uniformity  so 
that  all  appear  of  equal  brightness  across  the  range  of  full  ON  to  full 
OFF. 

5. 2. 1.2  Information  - 

5. 2. 1.2.1  Content  -  The  information  displayed  to  an  operator  shall  be 
limited  to  that  which  is  necessary  to  perform  specific  actions  or  to 
make  decisions. 

5. 2. 1.2. 2  Precision  -  Information  shall  be  displayed  only  to  the  degree 
of  specificity  and  precision  required  for  a  specific  operator  action  or 
decision. 


5. 2. 1.2. 3  Format  -  Information  shall  be  presented  to  the  operator  in 
a  directly  useable  form.  (Requirements  for  transposing,  computing, 
interpolating,  or  mental  translation  into  other  units  shall  be  avoided.) 

5. 2. 1.2. 4  Redundancy  -  Redundancy  in  the  display  of  information  to  a 
single  operator  shall  be  avoided  unless  it  is  required  to  achieve 
specified  reliability. 

5. 2. 1.2. 5  Combined  Information  -  Information  necessary  for  performing 
different  activities  (e.g.,  operation  and  troubleshooting)  shall  not 
simultaneously  appear  in  a  single  display  unless  they  are  comparable 
functions  requiring  the  same  information. 

5. 2. 1.2. 6  Display  Failure  Clarity  -  Displays  shall  be  so  designed  that 
failure  of  the  display  or  display  circuit  will  be  immediately  apparent 
to  the  operator. 

5. 2. 1.2. 7  Display  Circuit  Failure  -  Failure  of  the  display  circuit 
shall  not  cause  a  failure  in  the  equipment  associated  with  the  display. 

5. 2. 1.2. 8  Unrelated  Markings  -  Trademarks  and  company  names  or  other 
similar  markings  not  related  to  the  panel  function  shall  not  be  dis¬ 
played  on  the  panel  face. 


VISUAL  DISPLAYS 
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5 . 2 . 1 . 3  Location  and  Arrangement  - 

5. 2. 1.3.1  Accuracy  -  Displays  shall  be  located  and  designed  so  that 
they  may  be  read  to  the  degree  of  accuracy  required  by  personnel  in  the 
normal  operating  or  servicing  positions. 

5. 2. 1.3. 2  Access  -  Ladders,  supplementary  lighting,  or  other  special 
equipment  should  not  be  required  in  order  to  gain  access  to  or  to  read 
a  display. 

5. 2. 1.3. 3  Orientation  -  Display  faces  shall  be  perpendicular  to  the 
operator's  normal  line  of  sight  whenever  feasible  and  shall  not  be  less 
than  45°  from  the  normal  line  of  sight  (see  Figure  1).  Parallax  shall 
be  minimized. 

5. 2. 1.3. 4  Reflection  -  Displays  shall  be  constructed,  arranged,  and 
mounted  to  prevent  reduction  of  information  transfer  due  to  the  reflec¬ 
tion  of  the  ambient  illumination  from  the  display  cover.  Reflection  of 
instruments  and  consoles  in  windshields  and  other  enclosures  shall  be 
avoided.  If  necessary,  techniques  (such  as  shields  and  filters)  shall 
be  employed  to  insure  that  system  performance  will  not  be  degraded. 

5.2. 1.3.5  Vibration  -  Vibration  of  visual  displays  shall  not  degrade 
user  performance  below  the  level  required  for  mission  accomplishment 
(see  para  5. 8. 4. 2). 

5. 2. 1.3. 6  Grouping  -  All  displays  necessary  to  support  an  operator 
activity  or  sequence  of  activities,  shall  be  grouped  together. 

5. 2. 1.3. 7  Function  and  Sequence  -  Displays  shall  be  arranged  in  rela¬ 
tion  to  one  another  according  to  their  sequence  of  use  or  the  functional 
relations  of  the  components  they  represent.  They  shall  be  arranged  in 
sequence  within  functional  groups  whenever  possible  to  provide  a  viewing 
flow  from  left  to  right  or  top  to  bottom. 

5. 2. 1.3. 8  Frequency  of  Use  -  Displays  used  most  frequently  should  be 
grouped  together  and  placed  in  the  optimum  visual  zone  (see  Figure  2). 

5. 2. 1.3. 9  Importance  -  Very  important  or  critical  displays  shall  be 
placed  in  a  privileged  position  in  the  optimum  projected  visual  zone 
or  otherwise  highlighted. 

5.2.1.3.10  Consistency  -  The  arrangement  of  displays  shall  be  consistent 
in  principle  from  application  to  application,  within  the  limits  specified 
herein. 
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5.2.4  Cathode  Ray  Tube  (CRT)  Displays  - 

5.2.4. 1  Signal  Size  -  When  a  target  of  complex  shape  is  to  be  distin¬ 
guished  from  a  nontarget  shape  that  is  also  complex,  the  target  signal 
should  subtend  not  less  than  20  minutes  of  visual  angle  and  should  sub¬ 
tend  not  less  than  10  lines  or  resolution  elements.  Image  quality  shall 
be  consistent  with  the  operator's  needs. 

5. 2. 4. 2  Viewing  Distance  -  A  16-inch  (410  mm)  viewing  distance  shall 
be  provided  whenever  practicable.  When  periods  of  scope  observation 
will  be  short,  or  when  dim  signals  must  be  detected,  the  viewing  dis¬ 
tance  may  be  reduced  to  10  inches  (250  mm).  Design  should  permit  the 
observer  to  view  the  scope  from  as  close  as  he  may  wish.  Displays 
which  must  be  placed  at  viewing  distances  greater  than  16  inches  (410  trm) 
due  to  other  considerations  shall  be  appropriately  modified  in  aspects 
such  as  display  size,  symbol  size,  brightness  ranges,  line-pair  spacing 
and  resolution. 

5. 2. 4. 3  Screen  Luminance  -  The  ambient  illuminance  shall  not  contribute 
more  than  25%  of  screen  brightness  through  diffuse  reflection  and 
phosphor  excitation. 

5. 2.4.4  Faint  Signals  -  When  the  detection  of  faint  signals  is  required 
and  when  the  ambient  illuminance  may  be  above  0.25  FT-C  (2.7  lux),  scopes 
shall  be  hooded,  shielded,  or  recessed.  (In  some  instances,  a  suitable 
filter  system  may  be  employed,  subject  to  approval  by  the  procuring 
activity.) 

5. 2. 4. 5  Luminance  Range  -  The  luminance  range  of  surfaces  immediately 
adjacent  to  scopes  shall  be  between  10%  and  100%  of  screen  background 
luminance.  With  the  exception  of  emergency  indicators,  no  light  source 
in  the  immediate  surround  shall  be  brighter  than  scope  signals. 

5. 2. 4. 6  Ambient  Illuminance  -  The  ambient  illuminance  in  the  CRT  area 
shall  be  appropriate  for  other  visual  functions  (e.g.,  setting  controls, 
reading  instruments,  maintenance,  etc.)  but  shall  not  interfere  with  the 
visibility  of  signals  on  the  CRT  display. 

5. 2. 4. 7  Reflected  Glare  -  Reflected  glare  shall  be  minimized  by  proper 
placement  of  the  scope  relative  to  the  light  source,  use  of  a  hood  or 
shield,  or  optical  coatings  or  filter  control  over  the  light  source. 

5. 2. 4. 8  Adjacent  Surfaces  -  Surfaces  adjacent  to  the  scope  shall  have  a 
dull  matte  finish,  the  reflectances  of  these  surfaces  shall  be  such  that 
the  resultant  luminances  will  be  consistent  with  the  criteria  established 
above . 


5. 2. 4. 9  Electronically  or  Optically  Generated  Displays  -  Electronically 
or  optically  generated  displays  shall  conform  to  MIL-STD-884. 
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5.2.5  Large-Scale  Displays 

5.2.5. 1  Design  -  The  design  of  large-scale  displays  intended  for  group 
observation  shall  conform  with  the  basic  visual  criteria  in  other  para¬ 
graphs  of  this  standard,  and  the  additional  requirements  below.  Also, 
see  5. 2. 6. 6. 

5.2. 5.2  legibility  -  The  height-to-width  ratio,  stroke  width,  size,  and 
spacing  of  ai splay  symbols  shall  be  such  that  all  characters  will  be 
legible  at  the  maximum  viewing  angle  and  distance  (minimum  of  15'  arc). 

5.2.6  Other  Displays 

5.2.6. 1  General 


5. 2. 6. 1.1  Types  -  Where  applicable,  direct-reading  counters,  printers, 
plotters,  flags,  optical  projection  displays  and  light  emitting  diodes 
(LEDs)  should  be  considered. 

5. 2. 6. 1.2  Applications  -  The  selection  of  the  above  types  of  displays 
for  various  applications  should  be  based  on  the  following  specific 
criteria  as  well  as  the  criteria  in  Table  III. 

5. 2. 6. 3  Printers  - 

5. 2.6. 3.1  Application  -  Printers  should  be  used  when  a  visual  record 
of  data  is  necessary  or  desirable. 

5. 2. 6. 3.2  Form  of  Information  -  Printed  information  shall  be  presented 
in  a  directly  usable  form  with  minimal  requirements  for  decoding,  trans¬ 
posing,  and  interpolating. 

5.2.6. 3.3  Insertion  and  Removal  of  Materials  -  Printers  shall  be 
designed  to  provide  for  quick  and  easy  insertion  and  removal  of  printing 
materials. 

5. 2. 6. 3. 4  Take-up  Provision  -  A  take-up  device  for  printed  material 
shall  be  provided. 

5. 2. 6. 3. 5  Suppl ies  -  A  positive  indication  of  the  remaining  supply  of 
printing  materials  (e.g.,  paper,  ink,  and  ribbon)  shall  be  provided. 

5. 2. 6. 3. 6  Annotation  -  Where  applicable  printers  should  be  mounted  so 
that  the  tape  may  be  easily  annotated  while  still  in  the  recorder. 

5. 2. 6. 3. 7  Printed  Tapes  -  The  information  on  the  tapes  shall  be  printed 
in  such  a  manner  that  it  can  be  read  directly  when  it  is  received  from 
the  machine  without  requiring  the  cutting  and  pasting  of  sections  of 
tape. 


5. 2.6. 3.8  Visibility  -  The  printed  matter  shall  not  be  in  any  way 
hidden,  masked  or  obscured  so  that  direct  reading  cannot  be  easily 
and  accurately  accomplished. 
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5. 2. 6. 3. 9  Illumination  -  The  printer  shall  be  designed  with  internal 
illumination  if  the  printed  matter  is  not  completely  and  easily 
readable  in  the  operational  ambient  illumination  planned  for  the 
printer. 

5.2.6.3.10  Contrast  -  A  minimum  of  50'&  luminance  contrast  shall  be 
provided  between  the  printed  material  and  the  background  on  which  it 
is  printed. 

5. 2. 6. 4  Plotters  - 

5. 2. 6. 4.1  Use  -  Plotters  should  be  used  when  a  visual  record  of  con¬ 
tinuous  graphic  data  is  necessary  or  desirable. 

5. 2. 6. 4. 2  Visibility  -  Plotting  points  shall  be  readily  visible  and 
shall  not  be  obstructed  by  the  pen  assembly  or  arm. 

5. 2. 6. 4. 3  Contrast  -  A  minimum  of  50«.  contrast  shall  be  provided 
between  the  plotted  function  and  the  background  on  which  it  is  drawn. 

5. 2. 6. 4. 4  Take-up  Device  -  A  take-up  device  for  extruded  plotting 
materials  shall  be  provided  when  necessary  or  desirable. 

5. 2. 6. 4. 5  Job  Aids  -  Aids  (e.g.,  graphic  overlays)  shall  be  provided 
when  an  operator  is  required  to  interpret  graphic  data,  but  such  aids 
shall  not  obscure  or  distort  the  data. 
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5.5  LABELING  - 

5.5.1  General  - 

5. 5. 1.1  General  Requirements  -  Controls,  displays,  and  any  other  items 
of  equipment  that  must  be  located,  identified,  read,  or  manipulated  shall 
be  appropriately  and  clearly  labeled  to  permit  rapid  and  accurate  human 
performance.  No  label  will  be  required  on  equipment  or  controls  whose 
use  is  obvious  to  the  user  (e.g.,  aircraft  control  stick). 

5. 5. 1.2  Label  Characteristics  -  The  characteristics  of  the  labeling  to 
be  used  shall  be  determined  by  such  factors  as: 

a.  The  accuracy  of  identification  required 

b.  The  time  available  for  recognition  or  other  responses 

c.  The  distance  at  which  the  labels  must  be  read 

d.  The  illumination  level  and  color  characteristics  of  the 
illuminant 

e.  The  criticality  of  the  function  labeled 

f.  Consistency  of  label  design  within  and  between  systems. 

5. 5. 1.3  Prototype  and  Production  Equipment  Labels  -  Labels  for  both 
prototype  and  production  equipment  shall  meet  the  criteria  specified 
herein.  Labels  for  production  equipment  shall  be  designed  to  meet  the 
criteria  specified  for  the  duration  of  equipment  use.  Since  frequent 
design  changes  may.be  anticipated  in  prototype  equipment,  labels  for 
such  equipment  shall  be  designed  so  that  they  may  be  simply  and  easily 
affixed,  altered,  and  removed. 

5.5.2  Orientation  and  Location  - 

5. 5. 2.1  Orientation  -  Labels  and  information  thereon  should  be  oriented 
horizontally  so  that  they  may  be  read  quickly  and  easily  from  left  to 
right.  Vertical  orientation  shall  be  used  only  vrfien  labels  are  not 
critical  for  personnel  safety  or  performance  and  where  space  is  limited. 
When  used,  vertical  labels  shall  read  from  top  to  bottom. 

5. 5. 2. 2  Location  -  Labels  shall  be  placed  on  or  very  near  the  items 
which  they  identify,  so  as  to  eliminate  confusion  with  other  items  and 
labels.  Labels  shall  be  located  so  as  not  to  obscure  any  other  infor¬ 
mation  needed  by  the  operator.  Controls  shall  not  obscure  labels. 

5. 5. 2. 3  Standardization  -  Labels  shall  be  located  in  a  consistent 
manner  throughout  the  equipment  and  system. 


LABELING 
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5.5.3  Contents  - 

5. 5. 3.1  Equipment  Functions  -  Labels  should  primarily  describe  the 
functions  of  equipment  items.  Secondarily,  the  engineering  character¬ 
istics  or  nomenclature  may  be  described. 

5. 5. 3.2  Abbreviations  -  Standard  abbreviations  shall  be  selected  in 
accordance  with  MIL-STD-12,  MIL-STD-411,  or  MIL-STD-783.  If  a  new 
abbreviation  is  required,  its  meaning  shall  be  obvious  to  the  intended 
reader.  Capital  letters  shall  be  used.  Periods  shall  be  omitted  except 
when  needed  to  preclude  misinterpretation.  The  same  abbreviation  shall 
be  used  for  all  tenses  and  for  both  singular  and  plural  forms  of  a  word. 

5. 5. 3. 3  Irrelevant  Information  -  Trade  names  and  other  irrelevant 
information  shall  not  appear  on  labels  or  placards. 

5.5.4  Qualities  - 

5. 5.4.1  Brevity  -  Labels  shall  be  as  concise  as  possible  without  dis¬ 
torting  the  intended  meaning  or  information  and  shall  be  unambiguous. 
Redundancy  shall  be  minimized.  Where  the  general  function  is  obvious, 
only  the  specific  function  shall  be  identified  (e.g.,  frequency  as 
opposed  to  frequency  factor). 

5. 5. 4. 2  Familiarity  -  Words  shall  be  chosen  on  the  basis  of  operator 
familiarity  whenever  possible,  provided  the  words  express  exactly  what 
is  intended.  Brevity  shall  not  be  stressed  if  the  results  will  be 
unfamiliar  to  operating  personnel.  For  particular  users  (e.g.,  mainte¬ 
nance  technicians),  common  technical  terms  may  be  used  even  though  they 
may  be  unfamiliar  to  nonusers.  Abstract  symbols  (e.g.,  squares  and 
Greek  letters)  shall  be  used  only  when  they  have  a  commonly  accepted 
meaning  to  all  intended  readers.  Common,  meaningful  symbols  (e.g., 

%  and  +)  may  be  used  as  necessary. 

5.5.4. 3  Visibility  and  Legibility  -  Labels  and  placards  shall  be  de¬ 
signed  to  be  read  easily  and  accurately  at  the  anticipated  operational 
reading  distances,  vibration/motion  environment,  and  illumination  levels, 
taking  into  consideration  the  following  factors: 

a.  Contrast  between  the  lettering  and  its  immediate  background 

b.  Height,  width,  stroke  width,  spacing,  and  style  of  letters 
and  numerals 

c.  Method  of  application  (e.g.,  etching,  decal,  and  silk  screen) 

d.  Relative  legibility  of  alternative  words 

e.  Specular  reflection. 
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5 . 5 . 4 . 4  A( «  •»,»s  -  I  a be  Is  bhu  1 )  not  be  i  ovoreii  <n  ulr.iureU  by  other  units 
in  the  equipment  assembly . 

5. 5.4. 5  label  I  ile  -  Labels  shall  be  '.harp,  have  hi<jh  contrast,  and  be 
mounted  so  as  to  minimize  wear  or  obscurement  by  grease,  grime,  or  dirt. 

5. 5.4.6  Label  Background  -  Label  color  shall  contrast  with  the  equip¬ 
ment  background  specified  in  5.7.9.  No  special  background  for  the 
label  shall  be  provided  without  approval  by  the  procuring  activity. 

5.5.5  Design  of  Label  Characters  - 

5. 5.5.1  Black  Characters  -  Where  the  ambient  illuminance  will  be  above 

1  ft-C  (11  lux),  black  characters  shall  be  provided  on  a  light  background. 

5. 5. 5.2  Dark  Adaptation  -  Where  dark  adaptation  is  required,  the  dis¬ 
played  letters  or  numerals  shall  be  visible  without  interfering  with 
night  vision  requirements.  Where  possible,  markings  shall  be  white  on 
a  dark  background. 

5. 5. 5. 3  Style  -  Style  of  label  characters  shall  conform  to  MIL-M-18012, 
where  consistent  with  5. 5. 5. 4,  5. 5. 5. 5,  5. 5. 5. 7,  and  5. 5. 5.8,  herein. 
Labels  shall  be  prepared  in  capital  letters,  except  that  extended  copy 
(e.g.,  instructions)  shall  be  in  lower-case  letters. 

5. 5. 5.4  Letter  Width  -  The  width  of  letters  shall  preferably  be  3/5  of 

the  height,  except  for  the  "I”,  which  shall  be  one  stroke  in  width,  and 

the  "M"  and  "W",  which  shall  be  4/5  of  the  height. 

5. 5. 5. 5  Numeral  Width  -  The  width  of  numerals  shall  preferably  be  3/5 
of  the  height,  except  for  the  "4",  which  shall  be  one  stroke  width  wider, 
and  the  "1",  which  shall  be  one  stroke  in  width. 

5.5. 5.6  Wide  Characters  -  Where  conditions  indicate  the  use  of  wider 
characters,  as  on  a  curved  surface,  the  basic  height-to-width  ratio  may 
be  increased  to  1:1  in  accordance  with  MIL-M-18012. 

5. 5. 5. 7  Stroke  Width,  Normal  -  For  black  characters  on  a  white  (or 

light)  background,  the  stroke  width  shall  be  1/6  of  the  height. 

5. 5. 5. 8  Stroke  Width,  Dark  Adaptation  -  Where  dark  adaptation  is  re¬ 
quired  or  legibility  at  night  Is  a  critical  factor,  and  white  characters 
are  specified  on  a  black  background,  the  stroke  width  of  the  characters 
shall  be  from  1/7  to  1/8  of  the  height  (i.e.,  narrower  than  specified 
for  normal  daytime  vision). 

5. 5. 5. 9  Character  Spacing  -  The  minimum  space  between  characters  shall 
be  one  stroke  width. 
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5.5.5.10  Wtird  Sjiiic  iricj  -  Ihr  minimum  space  bct.wi ■> n  words  shall  be  the 
width  of  one  character. 


5.9.5.11  Line  Spacing  -  fhe  minimum  space  between  lines  shall  be  one- 
half  character  height. 

5.5.5.12  Label  Size  vs  Luminance  -  The  height  of  letters  and  numerals 
shall  be  determined  by  the  required  reading  distance  and  luminance. 
With  a  28-inch  (700  mm)  viewing  distance,  the  height  of  numerals  and 
letters  shall  be  within  the  range  of  values  in  Table  X  for  "low"  and 
"high"  control-display  luminance  conditions. 


5.5.5.13  Character  Height  and  Viewing  Distaricj  -  For  general  dial  and 
panel  design,  with  the  luminance  normally  above  1  ft-L  (3.4  cd/m^),  charac 
ter  height  should  approximate  the  values  given  below  for  various  distances 


Viewing  Distance 

a.  20  inches  ( 510  mm)  or  less 

b.  20  -  36  inches  (510-  910  mm) 

c.  36  -  72  inches  (910  mm  -  1.830  m) 

d.  72  -  144  inches  (1.830  -  3.660  m) 

e.  144  -  240  inches  (3.660  -  6.100  m) 


Height 

0.09  (2.3  nun) 
0.17  (4.3  run) 
0.34  (8.6  rim) 
0.68  (17  mm) 
1.13  (29  mm) 


5.5.6  Equipment  Labeling  - 

5. 5. 6.1  Assemblies,  Components,  and  Parts  - 


5. 5. 6. 1.1  General  Requirements  -  Each  assembly,  component,  and  part 
shall  be  labeled  with  a  clearly  visible,  readable,  and  meaningful  name, 
number,  or  symbol. 

5. 5. 6. 1.2  Location  -  The  gross  identifying  label  on  an  assembly  or 
major  component  shall  be  located: 


a.  Externally  in  such  a  position  that  it  is  not  obscured  by 
adjacent  assemblies  or  components 

b.  On  the  flattest,  most  uncluttered  surface  available 

c.  On  a  main  chassis  of  the  equipment 

d.  In  a  way  to  minimize  wear  or  obscurement  by  grease,  grime, 
or  dirt 


J 


\ 
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TABLE  X.  LABEL  SIZE  VERSUS  LUMINANCE 


MARKINGS 

HEIGHT*  1 

BELOW  1  ft-L 
(3.4  cd/m2) 

ABOVE  1  ft-L 
(3.4  od/m2) 

For  critical  mar  kings,  with  position 
variable  (a.g.,  numarab  on  countan 
and  (attabia  or  moving  social): 

0.20-0.30" 

16  -  7.6  mm) 

0.12-0.20" 

(3  —  6  mm) 

For  critical  markings,  with  position 
fixed  (a.g..  numarab  on  Read  scales, 
controb,  and  switch  markings,  or 
emergency  instructional: 

0.16-0.30" 

(3.0  -  7.6  mm) 

0.10-0.20" 

(2.6  -  6  mm) 

For  noncribcal  markings 
(a.g.,  identification  lebob.  routine 
instructions.  or  markings  required 
only  for  familiar  (ration). 

0.06-0.20" 

(1.3 -6  mm) 

0.06-0.20" 

(1.3 -6  mm) 

*Vakiat  mum  ■  Min.  (710  mm)  viewing  dliMct.  For  a 
distance,  D.  ofrjr  than  20  in.  (710  mm),  multiply  tha 
above  values  by  D/20  in.  (D/710  mm). 


ANNEX  D 
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MIL-STD-1472  para  5.7 
WORKSPACE  DESIGN  REQUIREMENTS 


b.  /  GKUUND  WOkkSPAl.l  hi  SIGN  KKHHKI.MI  NlS  - 


!> .  / .  I  Gemra  I  - 

5.7.1.1  Kick  Space  -  All  cabinets,  consoles,  and  work  surfaces  that 
require  an  operator  t.o  stand  or  sit  close  to  their  front  surfaces  shall 
contain  a  kick  space  at  the  base  at  least  4  inches  (100mm)  deep  and  4 
inches  (100mm)  high,  or  greater  to  allow  for  protective  or  specialized 
apparel . 

5. 7. 1.2  Handles  -  Handles  on  cabinets  and  consoles  shall  be  recessed 
whenever  practicable,  to  eliminate  projections  on  the  surface.  If 
handles  cannot  be  recessed,  they  shall  be  designed  such  that  they  shall 
neither  injure  personnel  nor  entangle  clothing  or  equipment. 

5. 7. 1.3  Work  Space  -  Whenever  feasible,  free  floor  space  of  at  least 

4  feet  ( 1 .220  m)  shal 1  be  provided  in  front  of  each  console.  For  equip¬ 
ment  racks  that  require  maintenance,  free  floor  space  shall  be  provided 
In  accordance  with  the  following  criteria,  whenever  feasible. 

5. 7. 1.3.1  Depth  of  Work  Area  -  The  distance  from  the  front  of  the  rack 
to  the  opposite  surface  or  obstacle  shall  be  no  less  than  42  inches 
(1.070  m). 

5. 7. 1.3. 2  Lateral  Work  Space  -  The  minimum  lateral  workspace  for  racks 
having  drawers  shall  be  as  follows  (measured  from  drawers  in  the  ex¬ 
tended  position): 


a.  For  racks  having  drawers  weighing  less  than  45  pounds 
(20.4  kg):  18  Inches  (460  mm)  on  one  side  and  4  Inches  (100  mm)  on 
the  other. 

b.  For  racks  having  drawers  weighing  over  45  pounds  (20.4  kg): 

18  inches  (460mm)  on  each  side. 

5. 7. 1.3. 3  Storage  S|)ace  -  Adequate  and  suitable  space  shall  be  provided 
on  consoles  or  immediate  work  space  for  the  storage  of  manuals,  work¬ 
sheets,  and  other  materials  that  are  required  for  use  by  the  operational 
or  maintenance  personnel. 

5. 7. 1.4  Panel  Slope  -  For  normal  console  operation,  the  slope  of  the 
control -display  panel  surface  shall  begin  at  the  level  of  the  console 
shelf. 

5.7.2  Standing  Operations  - 

5. 7.2.1  Work  Surface  -  Convenient  work  surfaces  to  support  job  instruc¬ 
tion  manuals,  worksheets,  etc.,  shall  be  provided  for  standing  operators. 
Work  benches  and  other  work  surfaces  shall  be  36  ±0.5  Inches  (915  ±15  mm) 
above  the  floor,  unless  otherwise  specified. 


GROUND  WORK* ACE 
OESIGN  REQUIREMENTS 
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cisely  and  frequently  shall  he  |> I .icimI  in  .in  area  between  50  inches 
(l.?70  m)  and  69  inches  ( I .  750  m)  above  the  standing  sur  I  ace. 

5. 7.2.4  Control  PI  a cement.  Normal  -  All  inntrol  .  mounted  on  a  vertical 
Surface  and  used  in  normal  equipment  opi  t  tl  ion  shall  lie  located  iri  an 
area  between  34  and  74  inches  (860  mm  and  l.fJdl)  m)  above  the  standing 
surface. 

5. 7.2.5  Control  Placement,  Special  -  Controls  requiring  precise  or 
frequent  operation  and  emergency  controls  shall  he  mounted  between  34 
and  57  inches  (860  mm  and  1.450  rn)  above  the  standing  surface  and  no 
further  than  22  inches  (560  mm)  laterally  from  the  centerline. 

5.7.3  Seated  Operations  - 

5. 7. 3.1  Work  Surface  Width  -  A  lateral  workspace  of  at  least  30  inches 
(760  mm)  wide  and  16  inches  (400  mm)  deep  shall  be  provided  whenever 
practicable. 

5. 7. 3.2  Work  Surface  Height  -  Desk  tops  and  writing  tables  shall  be 
29  to  31  inches  1740  to  790  mm)  above  the  floor,  unless  otherwise 
specified. 

5. 7. 3. 3  Writing  Surfaces  -  Where  a  writing  surface  is  required  on 
equipment  consoles,  it  "shall  be  at  least  16  inches  (400  mm)  deep  and 
should  be  24  inches  (610  nim)  wide,  when  consistent  with  operator  reach 
requirements. 

5. 7. 3.4  Seating  - 

5. 7. 3.4.1  Compatibility  -  Work  seating  shall  provide  an  adequate  sup¬ 
porting  framework  for  the  body  relative  to  the  activities  that  must  be 
carried  out.  Chairs  to  be  used  with  "sit"  consoles  shall  be  designed 
to  be  operationally  compatible  with  the  console  configuration. 

5. 7. 3.4.2  Vertical  Adjustment  -  Provision  shall  be  made  for  vertical 
seat  adjustment  from  16  to  21  inches  (400  to  525  mm)  in  increments  of 
no  more  than  1  inch  (25  mm)  each. 

5. 7. 3.4. 3  Back-rest  -  A  supporting  backrest  that  reclines  between  103“ 
and  115'  shaTl  be  provided.  The  backrest  shall  engage  the  lumbar  and 
thoracic  regions  of  the  back,  and  shall  support  the  torso  in  such  a 
position  that  the  operator's  eyes  can  be  brought  to  the  "Eye  Line"  with 
no  more  than  3  inches  (75  mm)  of  forward  body  movement. 
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b. 7.  1.4.4  Cushioning  -  Where  uppl  liable,  I.cit,  the  hackre*  t  and  seat 
shall  be  cushioned  with  at  leas!  I  null  (/‘.  min)  of  compre*  >ible  material 
and  provided  witfi  a  smooth  surface. 

5. 7. 3.4.5  Armrests  -  Unless  otherwise  specified,  armrests  shal  1  be  pro¬ 
vided.  Armrests  that  are  integral  with  operators'  chairs  shall  be  at 
least  2  inches  (SO  mm)  wide  ind  8  inches  (200  mm)  long.  Modified  or 
retractable  armrests  shall  be  provided  when  necessary  to  maintain  com¬ 
patibility  with  an  associated  console  and  shall  be  adjustable  from  7.5 
to  11  inches  (190  to  280  mm)  above  the  compressed  sitting  surface. 

5. 7. 3. 5  Knee  Room  -  Knee  and  foot  room  that,  equals  or  exceeds  the 
following  minimum  dimensions  shall  be  provided  beneath  work  surfaces: 

a.  Height:  25  inches  (640  mm).  If  a  footrest  is  provided, 
this  dimension  shall  be  increased  accordingly. 

b.  Width:  20  inches  (510mm) 

c.  Depth:  18  inches  (460  inn). 

5. 7. 3. 6  Display  Placement,  Normal  -  Visual  displays  mounted  on  vertical 
panels  and  used  in  normal  equipment  operation  shall  be  placed  in  an 
area  between  6  and  48  inches  (150  run  and  1.220  m)  above  the  sitting 
surface. 

5. 7. 3. 7  Display  Placement,  Special  -  Indicators  that  must  be  read  pre¬ 
cisely  and  frequently  shall  be  placed  in  an  area  between  14  and  37 
inches  (360  and  940  mm)  above  the  sitting  surface,  and  no  further  than 
22  inches  (560  mm)  laterally  from  the  centerline. 

5. 7. 3.8  Warning  Displays  -  For  "sit"  consoles  requiring  horizontal 
vision  over  the  top,  critical  visual  warning  displays  shall  be  mounted 
at  least  22.5  inches  (570  mm)  above  the  sitting  surface. 

5. 7. 3. 9  Control  Placement,  Normal  -  All  controls  mounted  on  a  vertical 
surface  and  used- in  normal  equipment  operation  shall  be  located  in  an 
area  between  8  and  35  inches  (200  and  890  mm)  above  the  sitting  surface. 

5.7.3.10  Control  Placement,  Special  -  Controls  requiring  precise  or 
frequent  operation  shall  be’  mounted’ between  8  and  30  inches  (200  and 
760  mm)  above  the  sitting  surface. 

5.7.4  Unusual  Positions  -  Anthropometric  data  for  the  design  and  sizing 
of  workspaces  involving  reaching,  stooping,  squatting,  kneeling,  crawl¬ 
ing,  or  prone  positions  are  presented  in  Table  XVII  and  Illustrated  In’ 
Figure  23.  Fifth  and  95th  percentile  values  are  given  for  various  body 
dimensions  in  both  inches  and  centimeters.  Since  these  data  represent 
nude  body  measurements,  suitable  allowances  must  be  made  for  heavy 

clothing  or  protective  equipment  when  required.  In  no  case  shall  clear¬ 
ance  dimensions  be  less  than  the  9‘>t.h  percentile  values  shown  in 
Tabic  XVII. 


— . 
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TABLE  XVII.  MALE  ANTHROPOMETRIC  DATA  FOR  WORKSPACES 


5TH  P 

ERCENTIlt 

95TH  PERCENTILE 

• 

INCHES 

CENTIMETERS 

INCHES 

CENTIMETERS 

1.  OVERHEAD  REACH  HEIGHT 

78  6 

199.6 

87.6 

222.6 

2.  MAXIMUM  OVERHEAD  REACH  HEIGHT 

83.3 

211.6 

93.6 

237.7 

3.  OVERHEAD  REACH  BREADTH 

13.6 

345 

18.9 

40.4 

4.  OVERHEAD  REACH.  ONE  ARM 

76.8 

195.1 

88.5 

224.8 

5.  MAXIMUM  BODY  DEPTH,  STANDING 

10.1 

26.7 

13.0 

33.0 

6.  MAXIMUM  BODY  BREADTH.  STANDING 

188 

47.8 

22.8 

67.9 

7.  BENT  TORSO  HEIGHT 

463 

117.6 

66.9 

142.0 

8.  BENT  TORSO  BREADTH 

16.3 

41.4 

19.1 

48.5 

9.  SQUATTING  HEIGHT 

40.8 

103.6 

47.0 

119.4 

10.  MAXIMUM  SQUATTING  BREADTH 

18.8 

47.8 

26.7 

86.3 

11.  TORSO  TO-KNEE  DEPTH.  SITTING 

12.1 

30.7 

16.6 

41.9 

12.  HAND-TO-HAND  BREADTH.  SITTING 

13.3 

33.8 

19.6 

49.8 

13.  KNEELING  HEIGHT 

48.2 

122.4 

64.4 

138.2 

14.  KNEELING  LEG  LENGTH 

24.3 

61.7 

28.7 

72.9 

16.  KNEELING  POSITION  HEIGHT 

29.7 

76.4 

34.4 

87.4 

18.  KNEELING  POSITION  LENGTH 

37.6 

96.6 

48.1 

122.2 

17.  CRAWLING  POSITION  HEIGHT 

26.2 

66.6 

30.6 

77.6 

18.  CRAWLING  POSITION  LENGTH 

49.3 

126.2 

68.2 

147.8 

19.  PRONE  POSITION  HEIGHT 

12.3 

31.2 

16.4 

41.7 

20.  PRONE  POSITION  LENGTH 

84.7 

216.1 

96.8 

243.3 

21.  HORIZONTAL  LENGTH 

66.0 

167.6 

73.9 

187.7 

22.  HORIZONTAL  LENGTH,  KNEES  BENT 

66.1 

140.0 

62-0 

167.6 

23.  ARM  REACH,  SUPINE 

26.4 

67.1 

32.2 

81.8 

24.  BENT  KNEE  HEIGHT,  SUPINE 

18.2 

46.2 

21.1 

163.6 

TABLE  XVIII.  STANDARD  CONSOLE  DIMENSIONS 
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NOTE:  All  dimantioni  ba**d  on  mat*  data. 


KEY 

DIMENSIONS 

INCHES 

(mm) 

A 

MAXIMUM  TOTAL  CONSOLE  HEIGHT  FROM  STANDING 
SURFACE 

c 

B 

SUGGESTED  VERTICAL  DIMENSION  OF  PANEL, 

INCL  SILLS 

s 

III 

* 

* 

* 

£ 

a 

C 

WRITING  SURFACE :  SHELF  HEIGHT  FROM  STANDING 

m 

SURFACE 

D 

WAT  HEIGHT  FROM  STANDING  SURFACE  AT  MIDPOINT 
OF  ‘O'* 

III 

u 

ui 

3 

E* 

MINIMUM  KNEE  CLEARANCE 

is 

1440) 

P* 

FOOT  SUPPORT  TO  SITTING  SURFACE  *' 

is 

(4S0) 

0« 

SEAT  ADJUSTABILITY 

s 

(1SS) 

H» 

MINIMUM  THIGH  CLEARANCE  AT  MIDPOINT  OF  ‘O'* 

S.6 

(IBS) 

1 

WRITING  SURFACE  DEPTH  INCLUDING  SHELF 

IS 

(400) 

J 

MINIMUM  SHELF  DEPTH 

4 

(100) 

K 

EYE  LINE-TO-CONSOLE  FRONT  DISTANCE 

IS 

(4001 

•NOT  APPLICABLE  TO  CONSOLS  TYPES  4  AND  6  OP  TABLE  XVIII. 

••SINCE  THIS  DIMENSION  MUST  NOT  BE  EXCEEDED,  A  HEEL  CATCH  MUST  BE  ADDED 
TO  THE  CHAIN  IP  "D"  EXCEEDS  IB”  I4S0  Mm). 


(NOTE:  ALL  DIMENSIONS  BASED  ON  MALE  DATA) 

Figure  24.  STANDARD  CONSOLE  DIMENSIONS  KEY 


ANNEX  E 


TACCDAS  Testbed  Human  Factors  Evaluation 


RATING  SCALE  EXAMPLES 
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ANNEX  f 
To 

TACCDAS  Testbed  Human  Factors  Evaluation 

OBSERVATION  REPORTING  CHECKLIST 


